2025-09-16 13:41:59.944 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:41:59.944 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:41:59.944 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:41:59.944 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:41:59.944 INFO 9 --- [ocp-schedules-17,418b43088ad97477,5b6d6c86f9dc4baf] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:41:59.945 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:41:59.945 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:41:59.945 INFO 9 --- [host-check-clockdiff1,418b43088ad97477,b40961dfc3d5fb47] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:41:59.945 INFO 9 --- [host-check-clockdiff2,418b43088ad97477,e78960788397ef3b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:41:59.945 INFO 9 --- [host-check-clockdiff3,418b43088ad97477,1f0a06865caecc54] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:41:59.945 INFO 9 --- [host-check-clockdiff4,418b43088ad97477,fffe6bb7e583fd13] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:41:59.945 INFO 9 --- [host-check-clockdiff5,418b43088ad97477,266ecc3213776676] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:41:59.945 INFO 9 --- [host-check-clockdiff6,418b43088ad97477,671c0cda7f00440d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:41:59.946 INFO 9 --- [ocp-schedules-3,4c0143398a479c91,ad6abaccca464b6b] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:41:59.949 INFO 9 --- [host-check-agent-status1,4c0143398a479c91,436b5b3ed1dd4e5b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:41:59.949 INFO 9 --- [ocp-schedules-5,064a6cf2b51760a7,db4f5674b01175a5] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:41:59.952 INFO 9 --- [host-check-agent-status2,4c0143398a479c91,1e45c4de11dea279] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:41:59.952 INFO 9 --- [host-check-clockdiff1,418b43088ad97477,b40961dfc3d5fb47] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001319 0 0 , error= 2025-09-16 13:41:59.952 INFO 9 --- [host-check-clockdiff4,418b43088ad97477,fffe6bb7e583fd13] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001319 0 0 , error= 2025-09-16 13:41:59.952 INFO 9 --- [host-check-clockdiff2,418b43088ad97477,e78960788397ef3b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001319 -1 -1 , error= 2025-09-16 13:41:59.952 INFO 9 --- [host-check-agent-status3,4c0143398a479c91,47cde535cd37d658] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:41:59.953 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:41:59.953 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:41:59.953 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:41:59.953 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:41:59.953 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:41:59.954 INFO 9 --- [host-check-clockdiff3,418b43088ad97477,1f0a06865caecc54] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001319 -1 -1 , error= 2025-09-16 13:41:59.954 INFO 9 --- [host-check-agent-status4,4c0143398a479c91,8809a870f4483b54] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:41:59.954 INFO 9 --- [host-check-agent-status5,4c0143398a479c91,7cbe43db84a39659] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:41:59.954 INFO 9 --- [host-check-agent-status6,4c0143398a479c91,c575c07122de7a3e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:41:59.954 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:41:59.954 INFO 9 --- [host-check-clockdiff6,418b43088ad97477,671c0cda7f00440d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001319 -1 -1 , error= 2025-09-16 13:41:59.954 INFO 9 --- [host-check-clockdiff5,418b43088ad97477,266ecc3213776676] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001319 -1 -1 , error= 2025-09-16 13:41:59.954 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:41:59.954 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:41:59.954 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:41:59.954 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:41:59.955 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:41:59.955 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:41:59.957 INFO 9 --- [host-check-agent-status3,4c0143398a479c91,47cde535cd37d658] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:41:59.957 INFO 9 --- [host-check-agent-status1,4c0143398a479c91,436b5b3ed1dd4e5b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:41:59.957 INFO 9 --- [host-check-agent-status4,4c0143398a479c91,8809a870f4483b54] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:41:59.958 INFO 9 --- [host-check-agent-status5,4c0143398a479c91,7cbe43db84a39659] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:41:59.958 INFO 9 --- [host-check-agent-status6,4c0143398a479c91,c575c07122de7a3e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:41:59.958 INFO 9 --- [host-check-agent-status1,4c0143398a479c91,436b5b3ed1dd4e5b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:41:59.958 INFO 9 --- [host-check-agent-status4,4c0143398a479c91,8809a870f4483b54] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:41:59.959 INFO 9 --- [host-check-agent-status3,4c0143398a479c91,47cde535cd37d658] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:41:59.959 INFO 9 --- [host-check-agent-status5,4c0143398a479c91,7cbe43db84a39659] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:41:59.959 INFO 9 --- [host-check-agent-status2,4c0143398a479c91,1e45c4de11dea279] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:41:59.959 INFO 9 --- [host-check-agent-status6,4c0143398a479c91,c575c07122de7a3e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:41:59.960 INFO 9 --- [host-check-agent-status2,4c0143398a479c91,1e45c4de11dea279] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:41:59.969 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:41:59.970 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:41:59.970 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:41:59.970 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:41:59.970 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:41:59.971 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:41:59.971 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:41:59.970049629+08:00 2025-09-16 13:41:59.971 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:41:59.971+08:00 2025-09-16 13:41:59.971 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:41:59.970609111+08:00 2025-09-16 13:41:59.972 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:41:59.971197260+08:00 2025-09-16 13:41:59.972 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:41:59.971+08:00 2025-09-16 13:41:59.972 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:41:59.971070820+08:00 2025-09-16 13:41:59.972 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:41:59.972+08:00 2025-09-16 13:41:59.972 INFO 9 --- [host-check-agent-status3,4c0143398a479c91,47cde535cd37d658] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:41:59.972 INFO 9 --- [host-check-agent-status4,4c0143398a479c91,8809a870f4483b54] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:41:59.972 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:41:59.971335879+08:00 2025-09-16 13:41:59.972 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:41:59.972+08:00 2025-09-16 13:41:59.972 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:41:59.972049009+08:00 2025-09-16 13:41:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:41:59.973 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:41:59.972+08:00 2025-09-16 13:41:59.973 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:41:59.972+08:00 2025-09-16 13:41:59.973 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:41:59.971+08:00 and status AVAILABLE 2025-09-16 13:41:59.973 INFO 9 --- [host-check-agent-status1,4c0143398a479c91,436b5b3ed1dd4e5b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:41:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:41:59.973 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:41:59.972+08:00 and status AVAILABLE 2025-09-16 13:41:59.973 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:41:59.971+08:00 and status AVAILABLE 2025-09-16 13:41:59.974 INFO 9 --- [host-check-agent-status6,4c0143398a479c91,c575c07122de7a3e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:41:59.974 INFO 9 --- [host-check-agent-status5,4c0143398a479c91,7cbe43db84a39659] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:41:59.974 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:41:59.972+08:00 and status AVAILABLE 2025-09-16 13:41:59.974 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:41:59.972+08:00 and status AVAILABLE 2025-09-16 13:41:59.974 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:41:59.972+08:00 and status AVAILABLE 2025-09-16 13:41:59.975 INFO 9 --- [host-check-agent-status2,4c0143398a479c91,1e45c4de11dea279] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:41:59.975 INFO 9 --- [host-check-agent-status3,4c0143398a479c91,47cde535cd37d658] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:41:59.975 INFO 9 --- [host-check-agent-status4,4c0143398a479c91,8809a870f4483b54] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:41:59.975 INFO 9 --- [host-check-agent-status3,4c0143398a479c91,47cde535cd37d658] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:41:59.975 INFO 9 --- [host-check-agent-status4,4c0143398a479c91,8809a870f4483b54] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:41:59.975 INFO 9 --- [host-check-agent-status3,4c0143398a479c91,47cde535cd37d658] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:41:59.975 INFO 9 --- [host-check-agent-status4,4c0143398a479c91,8809a870f4483b54] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:41:59.976 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:41:59.976 INFO 9 --- [host-check-agent-status1,4c0143398a479c91,436b5b3ed1dd4e5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:41:59.976 INFO 9 --- [host-check-agent-status1,4c0143398a479c91,436b5b3ed1dd4e5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:41:59.976 INFO 9 --- [host-check-agent-status1,4c0143398a479c91,436b5b3ed1dd4e5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status6,4c0143398a479c91,c575c07122de7a3e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status6,4c0143398a479c91,c575c07122de7a3e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status6,4c0143398a479c91,c575c07122de7a3e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status5,4c0143398a479c91,7cbe43db84a39659] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status5,4c0143398a479c91,7cbe43db84a39659] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status5,4c0143398a479c91,7cbe43db84a39659] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status2,4c0143398a479c91,1e45c4de11dea279] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status2,4c0143398a479c91,1e45c4de11dea279] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:41:59.977 INFO 9 --- [host-check-agent-status2,4c0143398a479c91,1e45c4de11dea279] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:41:59.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:41:59.979 INFO 9 --- [ocp-schedules-24,c00155273680d817,56aa813cce267a8f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:41:59.979 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:41:59.979 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:41:59.979 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:41:59.979 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:41:59.979 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:41:59.982 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:41:59.983 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:41:59.985 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:41:59.985 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:41:59.985 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:41:59.985 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:41:59.985 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:41:59.986 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:41:59.986 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:41:59.986 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:41:59.986 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:41:59.986 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:41:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:41:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:41:59.997 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:41:59.999 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:41:59.999 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:41:59.999 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:41:59.999 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:00.000 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:00.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:42:00.002902+08:00, lastProcessTime=2025-09-16T13:41:50.003566+08:00 2025-09-16 13:42:00.025 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:00.026 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:42:00.026 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:00.027 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:42:00.027 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:42:00.027 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:42:00.027 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:42:00.033 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:42:00.033 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:42:00.033 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:42:00.033 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:42:00.033 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:42:00.035 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:42:00.040 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:42:00.040 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:42:00.045 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:00.047 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:00.047 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:00.048 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:00.051 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:00.052 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:00.062 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:00.064 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:00.064 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:42:00.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:00.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:42:00.072 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:00.073 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:42:00.074 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:42:00.074 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:42:00.079 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:42:00.079 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:42:00.080 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:42:00.080 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:42:00.081 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:42:00.081 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:42:00.086 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:42:00.086 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:42:00.087 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.087 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:00.087 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:42:00.092 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:00.094 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:00.094 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:00.098 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:00.099 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:00.099 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:00.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:00.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:00.121 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:42:00.125 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:42:00.126 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:42:00.126 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:42:00.127 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:42:00.127 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:42:00.128 INFO 9 --- [host-check-host-status5,a311c4d27d699381,11828586e16a0809] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:42:00.132 INFO 9 --- [host-check-host-status2,a311c4d27d699381,92278f9e986ca3a0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:42:00.134 INFO 9 --- [host-check-host-status3,a311c4d27d699381,80d2da07e5d44b70] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:42:00.134 INFO 9 --- [host-check-host-status1,a311c4d27d699381,9d647cfaea21f868] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:42:00.134 INFO 9 --- [host-check-host-status6,a311c4d27d699381,77905069cbdf184f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:42:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.135 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:42:00.002902+08:00 2025-09-16 13:42:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:00.135 INFO 9 --- [host-check-host-status4,a311c4d27d699381,8d96c559e01dfd2f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:42:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:00.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:00.174 INFO 9 --- [ocp-async-7,3cc77a6633095baa,194d55b9a43a2836] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:42:00.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:00.221 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:00.234 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:00.236 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:00.236 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:00.241 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:42:00.244 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:42:00.247 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:42:00.327 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:42:00.338 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:00.339 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:00.340 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:00.342 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:00.343 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:42:00.357 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:42:00.357 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:42:00.357 INFO 9 --- [ocp-schedules-10,38bf0aa2fbfe2a8c,b3ce176277de2a07] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:42:00.747 WARN 9 --- [ocp-async-2,94b52bad31d4b4fc,9cb12a9ddc328be5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:00.747 INFO 9 --- [ocp-async-5,ffc4c9e7f83af331,ece6fddc23f57e31] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:00.795 INFO 9 --- [ocp-schedules-16,5b1e908e66b4468b,a14aa12538631242] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:42:01.636 INFO 9 --- [prometheus-minute-schedule-1,55c08e2616bd8369,4f3b036bc02c644f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:01.640 INFO 9 --- [prometheus-minute-schedule-1,55c08e2616bd8369,4f3b036bc02c644f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:02.747 WARN 9 --- [ocp-async-5,8bd64715bb32f9e9,f2f4eae1c62cbe99] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:02.747 INFO 9 --- [ocp-async-3,cc35d099a6368d4e,ffc78d71ca570347] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:03.339 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:03.340 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:04.511 INFO 9 --- [ocp-schedules-22,d4a49897d642812d,da72bc13324290b3] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:42:04.636 INFO 9 --- [prometheus-minute-schedule-1,aeb682669486f5ec,9fc38b8464ac3539] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:04.639 INFO 9 --- [prometheus-minute-schedule-1,aeb682669486f5ec,9fc38b8464ac3539] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:04.747 WARN 9 --- [ocp-async-3,d4827f7a5caa017e,0d283f99ef27df03] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:04.747 INFO 9 --- [ocp-async-4,f5cca51c2cce1d68,34193f595b8d624e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:06.340 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:06.340 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:06.747 WARN 9 --- [ocp-async-4,2ba2d16a236ff10f,ffd7327fae4915c3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:06.747 INFO 9 --- [ocp-async-10,c08c663f7155db66,03f598c921b779cc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:07.636 INFO 9 --- [prometheus-minute-schedule-1,a853f12946a7ad26,5284107d32214487] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:07.639 INFO 9 --- [prometheus-minute-schedule-1,a853f12946a7ad26,5284107d32214487] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:08.563 INFO 9 --- [ocp-schedules-13,b0bf2be928d27196,4183e60d371fc4ce] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:42:08.565 INFO 9 --- [ocp-schedules-13,b0bf2be928d27196,4183e60d371fc4ce] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:42:08.747 WARN 9 --- [ocp-async-10,9676bf06732ecdf9,b5d37621ffdea812] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:08.747 INFO 9 --- [ocp-async-9,238799ada1aef3e2,3afb4a4d15487072] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:08.836 INFO 9 --- [ocp-schedules-23,5e29322b4bf61d68,c63e1bf383e19fce] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:42:08.841 WARN 9 --- [scanner-1354157-1,5e29322b4bf61d68,3c78fffc5a49da8c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:42:09.340 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:09.341 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:10.002 INFO 9 --- [ocp-schedules-13,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:42:10.003 INFO 9 --- [ocp-schedules-29,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:42:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:42:10.003970+08:00, lastProcessTime=2025-09-16T13:42:00.002902+08:00 2025-09-16 13:42:10.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:42:10.003970+08:00 2025-09-16 13:42:10.174 INFO 9 --- [ocp-async-2,3d736bf193f6b49b,b8bbe8dcb34af935] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:42:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:42:10.636 INFO 9 --- [prometheus-minute-schedule-1,7b732dc2d6827526,2bff3ca73e3829c2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:10.639 INFO 9 --- [prometheus-minute-schedule-1,7b732dc2d6827526,2bff3ca73e3829c2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:10.747 WARN 9 --- [ocp-async-3,25f8cd04b40df06f,811a01d8d858412c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:10.747 INFO 9 --- [ocp-async-8,183c95dbf8fd958f,6f5e2717dfa73c8f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:11.672 INFO 9 --- [metric-archive-async-3,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001260, nodeCount=460, affectRows=460 2025-09-16 13:42:12.341 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:12.342 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:12.747 WARN 9 --- [ocp-async-2,e003f5b7222479f5,3fcf9f354b950f66] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:12.747 INFO 9 --- [ocp-async-6,2aaea8aaaf7b185f,a7910e2031c4567f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:13.002 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001260, nodeCount=1000, affectRows=1000 2025-09-16 13:42:13.004 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001260, nodeCount=1000, validCount=996 2025-09-16 13:42:13.030 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001260, nodeCount=1000, affectRows=1000 2025-09-16 13:42:13.032 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001260, nodeCount=1000, validCount=998 2025-09-16 13:42:13.043 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221682509) Duplicate entry '824147022761050114-1758001200' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221682509) Duplicate entry '824147022761050114-1758001200' for key 'PRIMARY' 2025-09-16 13:42:13.636 INFO 9 --- [prometheus-minute-schedule-1,18761a825501eed1,f393a46ad0c4b430] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:13.640 INFO 9 --- [prometheus-minute-schedule-1,18761a825501eed1,f393a46ad0c4b430] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:14.340 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001260, nodeCount=1000, affectRows=1000 2025-09-16 13:42:14.343 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001260, nodeCount=993, validCount=947 2025-09-16 13:42:14.366 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001260, nodeCount=853, affectRows=853 2025-09-16 13:42:14.368 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001260, nodeCount=852, validCount=850 2025-09-16 13:42:14.401 INFO 9 --- [ocp-schedules-4,c28251a9fe5cdb9b,45c3119bfb8725bc] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:42:14.406 INFO 9 --- [ocp-schedules-4,c28251a9fe5cdb9b,45c3119bfb8725bc] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:42:14.406 INFO 9 --- [ocp-schedules-4,c28251a9fe5cdb9b,45c3119bfb8725bc] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:42:14.514 INFO 9 --- [ocp-schedules-17,8c0ca58d7ae0c356,39899fa8b3b6dcca] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:42:14.747 WARN 9 --- [ocp-async-5,e5ca8e059da09f09,ac9826598a55af63] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:14.747 INFO 9 --- [ocp-async-7,11c7c4a7a8088743,591385cc1d114260] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:15.342 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:15.343 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:16.636 INFO 9 --- [prometheus-minute-schedule-1,22ddd22233bf09a3,d79d67fad8d1e277] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:16.640 INFO 9 --- [prometheus-minute-schedule-1,22ddd22233bf09a3,d79d67fad8d1e277] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:16.748 WARN 9 --- [ocp-async-9,f3e22642791c2518,fe1a1b07ce407e90] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:16.748 INFO 9 --- [ocp-async-1,ba64aaa78e3e6c3b,69e1aef8a8dfb18d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:18.343 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:18.343 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:18.570 INFO 9 --- [ocp-schedules-30,f45edf8e2b0f057e,b3913541b2c738b6] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:42:18.572 INFO 9 --- [ocp-schedules-30,f45edf8e2b0f057e,b3913541b2c738b6] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:42:18.748 WARN 9 --- [ocp-async-2,67a88a22c0c2fa87,52fb91799bfa1f7d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:18.748 INFO 9 --- [ocp-async-4,6748349c4f254b9b,30eabda0d27a85bc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:18.862 INFO 9 --- [ocp-schedules-25,882129261e379ffd,2de99582534a3c91] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:42:18.869 WARN 9 --- [scanner-1355152-1,882129261e379ffd,27d38305ac522e7d] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:42:18.879 INFO 9 --- [alarm-detect-3,882129261e379ffd,71838f119dc4a02b] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 34, data is empty. 2025-09-16 13:42:18.880 INFO 9 --- [alarm-detect-18,882129261e379ffd,bd74add4ef28572d] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 34, data is empty. 2025-09-16 13:42:18.881 INFO 9 --- [alarm-detect-7,882129261e379ffd,d248f880ccbaf099] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 34, data is empty. 2025-09-16 13:42:18.894 INFO 9 --- [alarm-detect-8,882129261e379ffd,0deba76167697982] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 34, data is empty. 2025-09-16 13:42:19.636 INFO 9 --- [prometheus-minute-schedule-1,a0a32cb05bbe9ed9,355413ddfc77babc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:19.640 INFO 9 --- [prometheus-minute-schedule-1,a0a32cb05bbe9ed9,355413ddfc77babc] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:42:20.004172+08:00, lastProcessTime=2025-09-16T13:42:10.003970+08:00 2025-09-16 13:42:20.121 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:42:20.004172+08:00 2025-09-16 13:42:20.174 INFO 9 --- [ocp-async-3,a3a793454ab8c70f,31abf583e3da4a2e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:42:20.636 INFO 9 --- [prometheus-cache-monitor1,a606eaf29d949cab,c45cf7221ac8017f] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:42:20.636 INFO 9 --- [prometheus-cache-monitor1,a606eaf29d949cab,c45cf7221ac8017f] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:42:20.748 WARN 9 --- [ocp-async-5,20b19df30f30584f,a1af07ec6ed26772] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:20.748 INFO 9 --- [ocp-async-7,0e1b9b205a8d74f5,f62d7ba6b3fa7c06] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:21.343 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:21.344 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:22.636 INFO 9 --- [prometheus-minute-schedule-1,ce37e343846bdb03,42d76379fe47cd94] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:22.640 INFO 9 --- [prometheus-minute-schedule-1,ce37e343846bdb03,42d76379fe47cd94] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:22.748 WARN 9 --- [ocp-async-3,36b838da7b072bd4,78c8f590456d728b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:22.748 INFO 9 --- [ocp-async-1,830c9275d119dd41,94cb118110e09dd6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:24.344 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:24.345 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:24.517 INFO 9 --- [ocp-schedules-7,11c111e35a2323cb,f94638e89ac98577] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:42:24.748 WARN 9 --- [ocp-async-8,2f4f15b54c4b2850,384d2efeed4dca69] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:24.748 INFO 9 --- [ocp-async-4,5819128781cf5be7,683aacc65dfe5cde] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:25.636 INFO 9 --- [prometheus-minute-schedule-1,fbed430bd3cf3d67,973dd1a51391629d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:25.640 INFO 9 --- [prometheus-minute-schedule-1,fbed430bd3cf3d67,973dd1a51391629d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:26.748 WARN 9 --- [ocp-async-5,1dd54b930d80dfe9,982a60b1f8ec3a65] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:26.748 INFO 9 --- [ocp-async-10,261af038b3c110cd,2b1cc7c325c223b6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:27.345 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:27.345 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:28.577 INFO 9 --- [ocp-schedules-7,580e6d9beae08fb4,873a0495bda19b18] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:42:28.579 INFO 9 --- [ocp-schedules-7,580e6d9beae08fb4,873a0495bda19b18] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:42:28.636 INFO 9 --- [prometheus-minute-schedule-1,be2f18930785802a,83d62980d087515d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:28.640 INFO 9 --- [prometheus-minute-schedule-1,be2f18930785802a,83d62980d087515d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:28.748 WARN 9 --- [ocp-async-3,e69449f9fb00ba4f,f713ce5ff21eaef7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:28.748 INFO 9 --- [ocp-async-9,fca52d860e2a130a,aab60c3b7815a8ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:28.896 INFO 9 --- [ocp-schedules-4,b53ff4eca73fb5d1,2117dd0d9ac272d9] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:42:28.901 WARN 9 --- [scanner-1355314-1,b53ff4eca73fb5d1,d28a4db6bc5d46e7] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:42:29.938 INFO 9 --- [ocp-schedules-8,06233f4f1f21b3af,d58029569bd801e2] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:42:29.941 INFO 9 --- [ocp-schedules-18,c9c65d160e8e8fe8,25cd4b9a4b1b0497] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:42:29.941 INFO 9 --- [ocp-schedules-3,6fcbdbf1fcb3abb2,eb412542dec22480] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:42:29.942 INFO 9 --- [ocp-schedules-23,a5756970162dce85,cea99648132d4a83] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:42:29.943 INFO 9 --- [ocp-schedules-3,6fcbdbf1fcb3abb2,eb412542dec22480] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:29.943 INFO 9 --- [ocp-schedules-18,c9c65d160e8e8fe8,25cd4b9a4b1b0497] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:29.943 INFO 9 --- [ocp-schedules-23,a5756970162dce85,cea99648132d4a83] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:29.944 INFO 9 --- [ocp-schedules-23,a5756970162dce85,cea99648132d4a83] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:42:29.944 INFO 9 --- [ocp-schedules-7,3763249a5665c438,078e7d6f5f1c5edf] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:42:29.944 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:42:29.944 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:42:29.945 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:42:29.945 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:42:29.945 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:42:29.945 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:42:29.945 INFO 9 --- [ocp-schedules-24,3b2fdae963b2f530,3e35be9fb9a0de67] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:42:29.945 INFO 9 --- [host-check-clockdiff1,3b2fdae963b2f530,1e4929d9f56d58a3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:42:29.945 INFO 9 --- [ocp-schedules-11,a32e7573dc81a4ed,263834219ec53c94] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:42:29.945 INFO 9 --- [host-check-clockdiff2,3b2fdae963b2f530,18c517fc5b7fee75] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:42:29.945 INFO 9 --- [host-check-clockdiff3,3b2fdae963b2f530,16d06c59fef2814b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:42:29.945 INFO 9 --- [host-check-clockdiff4,3b2fdae963b2f530,043fefbf5e13799e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:42:29.945 INFO 9 --- [host-check-agent-status1,a32e7573dc81a4ed,1c855fc87550cc2d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:42:29.945 INFO 9 --- [host-check-clockdiff5,3b2fdae963b2f530,39994ce0cc576fcb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:42:29.945 INFO 9 --- [host-check-agent-status2,a32e7573dc81a4ed,52bbd729416af0f5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:42:29.946 INFO 9 --- [host-check-clockdiff6,3b2fdae963b2f530,808d2a2d1f7a6da7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:42:29.946 INFO 9 --- [host-check-agent-status3,a32e7573dc81a4ed,cb77c9055cce7cfa] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:42:29.946 INFO 9 --- [host-check-agent-status4,a32e7573dc81a4ed,4c2cdcc3454be2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:42:29.946 INFO 9 --- [host-check-agent-status5,a32e7573dc81a4ed,732f6e94d8e25954] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:42:29.946 INFO 9 --- [host-check-agent-status6,a32e7573dc81a4ed,cdecc5113d19ad6c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:42:29.947 INFO 9 --- [ocp-schedules-17,d73ad52af5dd19df,885e620ead3667f5] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:42:29.953 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:42:29.953 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:29.953 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:42:29.953 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:42:29.953 INFO 9 --- [host-check-clockdiff2,3b2fdae963b2f530,18c517fc5b7fee75] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001349 -1 -1 , error= 2025-09-16 13:42:29.953 INFO 9 --- [host-check-clockdiff5,3b2fdae963b2f530,39994ce0cc576fcb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001349 -1 -1 , error= 2025-09-16 13:42:29.953 INFO 9 --- [host-check-clockdiff4,3b2fdae963b2f530,043fefbf5e13799e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001349 -1 -1 , error= 2025-09-16 13:42:29.953 INFO 9 --- [host-check-clockdiff6,3b2fdae963b2f530,808d2a2d1f7a6da7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001349 -1 -1 , error= 2025-09-16 13:42:29.953 INFO 9 --- [host-check-clockdiff1,3b2fdae963b2f530,1e4929d9f56d58a3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001349 -1 -1 , error= 2025-09-16 13:42:29.955 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:42:29.957 INFO 9 --- [host-check-agent-status1,a32e7573dc81a4ed,1c855fc87550cc2d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:42:29.957 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:42:29.957 INFO 9 --- [host-check-agent-status2,a32e7573dc81a4ed,52bbd729416af0f5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:42:29.957 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:29.957 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:42:29.957 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:42:29.958 INFO 9 --- [host-check-agent-status4,a32e7573dc81a4ed,4c2cdcc3454be2c5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:42:29.958 INFO 9 --- [host-check-agent-status3,a32e7573dc81a4ed,cb77c9055cce7cfa] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:42:29.958 INFO 9 --- [host-check-agent-status5,a32e7573dc81a4ed,732f6e94d8e25954] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:42:29.958 INFO 9 --- [host-check-agent-status6,a32e7573dc81a4ed,cdecc5113d19ad6c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:29.958 INFO 9 --- [host-check-clockdiff3,3b2fdae963b2f530,16d06c59fef2814b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001349 -1 -1 , error= 2025-09-16 13:42:29.958 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:42:29.959 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:42:29.959 INFO 9 --- [host-check-agent-status2,a32e7573dc81a4ed,52bbd729416af0f5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:42:29.959 INFO 9 --- [host-check-agent-status6,a32e7573dc81a4ed,cdecc5113d19ad6c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:29.959 INFO 9 --- [host-check-agent-status1,a32e7573dc81a4ed,1c855fc87550cc2d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:42:29.959 INFO 9 --- [host-check-agent-status4,a32e7573dc81a4ed,4c2cdcc3454be2c5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:42:29.959 INFO 9 --- [host-check-agent-status3,a32e7573dc81a4ed,cb77c9055cce7cfa] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:42:29.959 INFO 9 --- [host-check-agent-status5,a32e7573dc81a4ed,732f6e94d8e25954] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:42:29.959 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:42:29.962 INFO 9 --- [ocp-schedules-26,f437114f6bf78e01,2f0b1baa79ad800e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:42:29.963 INFO 9 --- [ocp-schedules-27,7ae6647290aad4bc,aa6b46b0b90053f3] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:42:29.967 INFO 9 --- [ocp-schedules-26,f437114f6bf78e01,2f0b1baa79ad800e] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:42:29.970 INFO 9 --- [ocp-schedules-27,7ae6647290aad4bc,aa6b46b0b90053f3] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:42:29.973 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-agent-status6,a32e7573dc81a4ed,cdecc5113d19ad6c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-agent-status2,a32e7573dc81a4ed,52bbd729416af0f5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-agent-status3,a32e7573dc81a4ed,cb77c9055cce7cfa] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-agent-status5,a32e7573dc81a4ed,732f6e94d8e25954] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:42:29.974 INFO 9 --- [host-check-agent-status1,a32e7573dc81a4ed,1c855fc87550cc2d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:42:29.975 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:42:29.975 INFO 9 --- [host-check-agent-status4,a32e7573dc81a4ed,4c2cdcc3454be2c5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:42:29.975 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:42:29.974013548+08:00 2025-09-16 13:42:29.975 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:42:29.974320113+08:00 2025-09-16 13:42:29.975 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:42:29.975+08:00 2025-09-16 13:42:29.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:29.975 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:42:29.974612811+08:00 2025-09-16 13:42:29.975 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:42:29.974543333+08:00 2025-09-16 13:42:29.976 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:42:29.975+08:00 2025-09-16 13:42:29.976 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:42:29.975268002+08:00 2025-09-16 13:42:29.976 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:42:29.975+08:00 2025-09-16 13:42:29.976 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:42:29.976+08:00 2025-09-16 13:42:29.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:29.976 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:42:29.976+08:00 2025-09-16 13:42:29.977 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:42:29.976415795+08:00 2025-09-16 13:42:29.977 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:42:29.975+08:00 and status AVAILABLE 2025-09-16 13:42:29.977 INFO 9 --- [host-check-agent-status3,a32e7573dc81a4ed,cb77c9055cce7cfa] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:42:29.977 INFO 9 --- [host-check-agent-status3,a32e7573dc81a4ed,cb77c9055cce7cfa] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:42:29.977 INFO 9 --- [host-check-agent-status3,a32e7573dc81a4ed,cb77c9055cce7cfa] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:42:29.977 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:42:29.975+08:00 and status AVAILABLE 2025-09-16 13:42:29.977 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:42:29.977+08:00 2025-09-16 13:42:29.977 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:42:29.975+08:00 and status AVAILABLE 2025-09-16 13:42:29.978 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:42:29.976+08:00 and status AVAILABLE 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status6,a32e7573dc81a4ed,cdecc5113d19ad6c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status6,a32e7573dc81a4ed,cdecc5113d19ad6c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status6,a32e7573dc81a4ed,cdecc5113d19ad6c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:42:29.978 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:42:29.976+08:00 and status AVAILABLE 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status2,a32e7573dc81a4ed,52bbd729416af0f5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status2,a32e7573dc81a4ed,52bbd729416af0f5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status2,a32e7573dc81a4ed,52bbd729416af0f5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status5,a32e7573dc81a4ed,732f6e94d8e25954] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status5,a32e7573dc81a4ed,732f6e94d8e25954] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:42:29.978 INFO 9 --- [host-check-agent-status5,a32e7573dc81a4ed,732f6e94d8e25954] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:42:29.979 INFO 9 --- [host-check-agent-status1,a32e7573dc81a4ed,1c855fc87550cc2d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:42:29.979 INFO 9 --- [host-check-agent-status1,a32e7573dc81a4ed,1c855fc87550cc2d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:42:29.979 INFO 9 --- [host-check-agent-status1,a32e7573dc81a4ed,1c855fc87550cc2d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:42:29.979 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:42:29.977+08:00 and status AVAILABLE 2025-09-16 13:42:29.979 INFO 9 --- [host-check-agent-status4,a32e7573dc81a4ed,4c2cdcc3454be2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:42:29.979 INFO 9 --- [host-check-agent-status4,a32e7573dc81a4ed,4c2cdcc3454be2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:42:29.979 INFO 9 --- [host-check-agent-status4,a32e7573dc81a4ed,4c2cdcc3454be2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:42:29.980 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:42:29.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:42:29.981 INFO 9 --- [ocp-schedules-3,6fcbdbf1fcb3abb2,eb412542dec22480] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:42:29.982 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:42:29.982 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:42:29.982 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:42:29.982 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:42:29.983 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:42:29.986 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:29.987 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:29.987 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:42:29.987 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:42:29.987 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:42:29.988 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:42:29.988 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:42:29.988 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:42:29.988 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:42:29.989 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:42:29.989 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:42:29.990 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:42:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:29.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:42:30.000 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:30.001 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:30.002 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:30.002 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:30.003 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:30.004 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:42:30.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:42:30.004707+08:00, lastProcessTime=2025-09-16T13:42:20.004172+08:00 2025-09-16 13:42:30.028 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:42:30.028 INFO 9 --- [ocp-schedules-13,352e11d3fd7a31cc,2b5d4439982681d1] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:42:30.029 INFO 9 --- [ocp-schedules-13,352e11d3fd7a31cc,2b5d4439982681d1] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:42:30.029 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:42:30.030 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:30.031 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:42:30.031 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:42:30.031 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:30.032 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:42:30.034 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:42:30.035 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:42:30.035 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:42:30.037 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:42:30.037 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:42:30.038 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:42:30.041 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:42:30.043 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:42:30.047 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:30.049 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:30.049 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:30.050 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:30.051 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:30.055 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:42:30.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:30.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:30.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:42:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:42:30.074 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:42:30.075 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:30.077 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:42:30.079 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:42:30.079 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:42:30.079 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:42:30.081 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:42:30.083 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:42:30.083 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:42:30.085 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:42:30.085 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:42:30.086 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:42:30.090 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:42:30.091 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.091 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:30.094 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:30.095 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:30.096 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:30.097 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:30.099 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:30.101 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:42:30.101 INFO 9 --- [prometheus-second-schedule-1,23f704a09f3c5229,73d8e55ee38d02a1] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:42:30.107 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.107 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:30.121 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.121 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:30.123 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:42:30.124 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:42:30.125 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:42:30.126 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:42:30.128 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:42:30.128 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:42:30.130 INFO 9 --- [host-check-host-status5,3763249a5665c438,3a14ea3bbc313fa7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:42:30.131 INFO 9 --- [host-check-host-status3,3763249a5665c438,899b67318da9a076] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:42:30.131 INFO 9 --- [host-check-host-status6,3763249a5665c438,e8c46b9d21af9fd8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:42:30.132 INFO 9 --- [host-check-host-status2,3763249a5665c438,dd550df0e5f0f3af] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:42:30.134 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:42:30.004707+08:00 2025-09-16 13:42:30.135 INFO 9 --- [host-check-host-status1,3763249a5665c438,c13539ca1eaf6145] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:42:30.135 INFO 9 --- [host-check-host-status4,3763249a5665c438,e2993e10ffbaf66d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:42:30.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:30.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:30.167 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.167 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:30.175 INFO 9 --- [ocp-async-10,c522e0c6e08c5efd,0675c0fc1d2f5c7b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:42:30.181 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.181 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:30.197 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.197 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:42:30.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:42:30.224 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:42:30.237 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:30.239 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:30.240 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:30.244 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:42:30.247 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:42:30.250 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:30.251 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:30.255 INFO 9 --- [ocp-schedules-10,fe0501293e2aa280,6dde483c4ea83041] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:42:30.256 INFO 9 --- [ocp-schedules-10,fe0501293e2aa280,6dde483c4ea83041] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:30.256 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:42:30.256 INFO 9 --- [ocp-schedules-10,fe0501293e2aa280,6dde483c4ea83041] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:42:30.264 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:42:30.328 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:42:30.341 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:30.343 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:30.344 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:42:30.345 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:30.346 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:42:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:42:30.358 INFO 9 --- [ocp-schedules-18,c9c65d160e8e8fe8,25cd4b9a4b1b0497] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:42:30.378 INFO 9 --- [ocp-schedules-16,d04b9f36aaef2f23,3ee545a50d50d5f5] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:42:30.552 INFO 9 --- [ocp-schedules-19,6ce72dcbb24ff25c,ec3bdef65e0955e7] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:42:30.554 INFO 9 --- [ocp-schedules-19,6ce72dcbb24ff25c,ec3bdef65e0955e7] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:42:30.554 INFO 9 --- [ocp-schedules-19,6ce72dcbb24ff25c,ec3bdef65e0955e7] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:42:30.748 WARN 9 --- [ocp-async-5,e4ce79c4b49883ef,6db86af846cf17c1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:30.748 INFO 9 --- [ocp-async-6,302ceb17a19b43ab,8aa518aac6009442] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:30.797 INFO 9 --- [ocp-schedules-3,66b5cb4ff043052d,13788188ffdebd2c] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:42:30.936 INFO 9 --- [ocp-schedules-13,d0f684a189eab06f,5064a3da7e3a2245] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:42:30.936 INFO 9 --- [ocp-schedules-13,d0f684a189eab06f,5064a3da7e3a2245] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:42:31.396 INFO 9 --- [ocp-schedules-7,8d86e1c2ac7e6494,0ae5aabe401f6c56] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:42:31.396 INFO 9 --- [ocp-schedules-7,8d86e1c2ac7e6494,0ae5aabe401f6c56] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001351 2025-09-16 13:42:31.397 INFO 9 --- [ocp-schedules-7,8d86e1c2ac7e6494,0ae5aabe401f6c56] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:42:31.568 INFO 9 --- [ocp-schedules-15,6fd55a81b68f4086,83b32252725abb6c] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:42:31.618 INFO 9 --- [ocp-schedules-9,527583f4be187d90,ff52ff96d88f953d] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:42:31.636 INFO 9 --- [prometheus-minute-schedule-1,23a06f94be5392d1,6445c3d5dd6e20c7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:31.639 INFO 9 --- [prometheus-minute-schedule-1,23a06f94be5392d1,6445c3d5dd6e20c7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:31.655 INFO 9 --- [ocp-schedules-25,7998e599de8ff8eb,49220d6bce45d7ff] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:42:31.655 INFO 9 --- [ocp-schedules-25,7998e599de8ff8eb,49220d6bce45d7ff] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:42:31.656 INFO 9 --- [ocp-schedules-25,7998e599de8ff8eb,49220d6bce45d7ff] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:42:31.656 INFO 9 --- [ocp-schedules-25,7998e599de8ff8eb,49220d6bce45d7ff] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:42:31.656 INFO 9 --- [ocp-schedules-25,7998e599de8ff8eb,49220d6bce45d7ff] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:42:31.656 INFO 9 --- [ocp-schedules-25,7998e599de8ff8eb,49220d6bce45d7ff] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:42:31.672 INFO 9 --- [ocp-schedules-10,4fdbde7da9274b27,8eaddfa0a83a306f] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:42:31.673 INFO 9 --- [ocp-schedules-10,4fdbde7da9274b27,8eaddfa0a83a306f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:31.688 INFO 9 --- [ocp-schedules-10,4fdbde7da9274b27,8eaddfa0a83a306f] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:42:32.748 WARN 9 --- [ocp-async-10,766e5488b53f0b37,fc5985cbc657f859] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:32.748 INFO 9 --- [ocp-async-7,f4baaa838dd73bb5,6242c6ffc5cfba5b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:33.246 INFO 9 --- [ocp-schedules-9,5a52669c262e797d,24daee7d2b13614d] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:42:33.346 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:33.346 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:33.358 INFO 9 --- [ocp-schedules-22,db8fe384b5600458,b17cc811f5d1ab37] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:42:33.358+08:00, clusters=[1] 2025-09-16 13:42:33.360 INFO 9 --- [ocp-schedules-22,db8fe384b5600458,b17cc811f5d1ab37] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:42:33.919 INFO 9 --- [ocp-schedules-12,e4ca7d243e85eb1a,f67bbaf6e5712789] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:42:33.919 INFO 9 --- [ocp-schedules-12,e4ca7d243e85eb1a,f67bbaf6e5712789] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:42:33.919 INFO 9 --- [ocp-schedules-12,e4ca7d243e85eb1a,f67bbaf6e5712789] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:42:33.935 INFO 9 --- [ocp-schedules-12,e4ca7d243e85eb1a,f67bbaf6e5712789] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:42:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:42:34.408 INFO 9 --- [ocp-schedules-26,3133f6b6246782c8,ebf5810cdfda0250] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:42:34.412 INFO 9 --- [ocp-schedules-26,3133f6b6246782c8,ebf5810cdfda0250] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:42:34.412 INFO 9 --- [ocp-schedules-26,3133f6b6246782c8,ebf5810cdfda0250] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:42:34.521 INFO 9 --- [ocp-schedules-17,4eef3fe3312eef1d,52850a9e376cd539] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:42:34.636 INFO 9 --- [prometheus-minute-schedule-1,127cffda63a8247d,7b3feef8236cf040] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:34.640 INFO 9 --- [prometheus-minute-schedule-1,127cffda63a8247d,7b3feef8236cf040] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:34.717 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,56c8b551f46a1764,f10f3aab1041886f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=56c8b551f46a1764, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:42:34.717 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,56c8b551f46a1764,f10f3aab1041886f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=56c8b551f46a1764, duration=1 ms] 2025-09-16 13:42:34.749 WARN 9 --- [ocp-async-9,fe61bb32f34b5710,7e533938d4285641] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:34.749 INFO 9 --- [ocp-async-8,2787545e92d3b8b0,213f6101c113efd9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:35.354 INFO 9 --- [ocp-schedules-18,34c612ee126f1224,36846460bdfe6ba0] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:42:35.354+08:00, clusters=[1] 2025-09-16 13:42:35.358 INFO 9 --- [ocp-schedules-18,34c612ee126f1224,36846460bdfe6ba0] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:42:36.347 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:36.347 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:36.749 WARN 9 --- [ocp-async-4,d891c9b496249144,7b08466a672a62a3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:36.749 INFO 9 --- [ocp-async-2,99a32017deefe29c,8788eb7e100a2d19] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:37.378 INFO 9 --- [ocp-schedules-11,46df25b043fa9cad,4a6b063ede885353] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:42:37.380 INFO 9 --- [ocp-schedules-11,46df25b043fa9cad,4a6b063ede885353] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:37.400 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:37.401 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:42:37.413 INFO 9 --- [ocp-schedules-11,46df25b043fa9cad,4a6b063ede885353] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:42:37.636 INFO 9 --- [prometheus-minute-schedule-1,9e72147dacd9a840,df365a087c1be4cd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:37.639 INFO 9 --- [prometheus-minute-schedule-1,9e72147dacd9a840,df365a087c1be4cd] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:38.584 INFO 9 --- [ocp-schedules-2,75158049c15bc201,a6e357141da0d8b3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:42:38.586 INFO 9 --- [ocp-schedules-2,75158049c15bc201,a6e357141da0d8b3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:42:38.749 WARN 9 --- [ocp-async-6,d0aa2b0e274f2e53,fc8e9a95fa56fea0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:38.749 INFO 9 --- [ocp-async-3,b31d87f1f51590a1,47d7e3fd2d449402] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:38.925 INFO 9 --- [ocp-schedules-23,416d4e506a7171da,e417525a20488a70] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:42:38.930 WARN 9 --- [scanner-1355444-1,416d4e506a7171da,117c6401036a755d] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:42:38.940 INFO 9 --- [alarm-detect-3,416d4e506a7171da,b409f387c3446cdf] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 34, data is empty. 2025-09-16 13:42:38.942 INFO 9 --- [alarm-detect-4,416d4e506a7171da,754ae37b1de70589] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 34, data is empty. 2025-09-16 13:42:38.942 INFO 9 --- [alarm-detect-15,416d4e506a7171da,d98102f01e7a78aa] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 34, data is empty. 2025-09-16 13:42:38.954 INFO 9 --- [alarm-detect-9,416d4e506a7171da,92221e05e76a0cf6] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 34, data is empty. 2025-09-16 13:42:39.333 INFO 9 --- [ocp-schedules-7,98763c7fd85ae339,31b69b151263d9cb] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:42:39.333 INFO 9 --- [ocp-schedules-7,98763c7fd85ae339,31b69b151263d9cb] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:42:39.339 INFO 9 --- [ocp-schedules-22,abb527f89549d728,242fc5844a4de609] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:42:39.339 INFO 9 --- [ocp-schedules-22,abb527f89549d728,242fc5844a4de609] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:42:39.339 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:42:39.339 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:42:39.339 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:42:39.339 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:42:39.343 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:42:39.343 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:42:39.343 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:42:39.343 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:39.343 INFO 9 --- [ocp-schedules-22,abb527f89549d728,242fc5844a4de609] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:42:39.344 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:42:39.344 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:42:39.344 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:42:39.344 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:39.344 INFO 9 --- [ocp-schedules-22,abb527f89549d728,242fc5844a4de609] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:42:39.347 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:39.348 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:39.349 INFO 9 --- [Collect all tenants major compactions1,98763c7fd85ae339,df21d1463e5c050b] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:42:39.349 INFO 9 --- [Collect all tenants major compactions2,98763c7fd85ae339,e7bdfffaa9ce9e11] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:42:39.349 INFO 9 --- [Collect all tenants major compactions3,98763c7fd85ae339,a75dc86c26ef11ed] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:42:39.358 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:42:39.358 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:42:39.358 INFO 9 --- [ocp-schedules-22,abb527f89549d728,242fc5844a4de609] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:42:39.359 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:42:39.359 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:42:39.360 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:42:39.363 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:42:39.364 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:42:39.367 INFO 9 --- [Collect all tenants major compactions1,98763c7fd85ae339,df21d1463e5c050b] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:39.368 INFO 9 --- [Collect all tenants major compactions3,98763c7fd85ae339,a75dc86c26ef11ed] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:39.368 INFO 9 --- [Collect all tenants major compactions2,98763c7fd85ae339,e7bdfffaa9ce9e11] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:39.369 INFO 9 --- [Collect all tenants major compactions3,98763c7fd85ae339,a75dc86c26ef11ed] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:42:39.369 INFO 9 --- [Collect all tenants major compactions1,98763c7fd85ae339,df21d1463e5c050b] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:42:39.369 INFO 9 --- [Collect all tenants major compactions2,98763c7fd85ae339,e7bdfffaa9ce9e11] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:42:39.372 INFO 9 --- [Collect all tenants major compactions1,98763c7fd85ae339,df21d1463e5c050b] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:42:39.373 INFO 9 --- [Collect all tenants major compactions3,98763c7fd85ae339,a75dc86c26ef11ed] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:42:39.374 INFO 9 --- [Collect all tenants major compactions2,98763c7fd85ae339,e7bdfffaa9ce9e11] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:42:39.375 INFO 9 --- [ocp-schedules-7,98763c7fd85ae339,31b69b151263d9cb] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:42:39.378 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:42:39.380 INFO 9 --- [ocp-schedules-22,abb527f89549d728,242fc5844a4de609] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:42:40.003 INFO 9 --- [ocp-schedules-16,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:42:40.004 INFO 9 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:42:40.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:42:40.005957+08:00, lastProcessTime=2025-09-16T13:42:30.004707+08:00 2025-09-16 13:42:40.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:42:40.005957+08:00 2025-09-16 13:42:40.175 INFO 9 --- [ocp-async-5,fa004483d8c58fee,ddcb40a2d9890fcc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:42:40.451 INFO 9 --- [ocp-schedules-26,d8fa3f2f625d0d08,9a015b3532750a50] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:42:40.452 INFO 9 --- [ocp-schedules-26,d8fa3f2f625d0d08,9a015b3532750a50] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:40.498 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:42:40.498 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.501 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:42:40.529 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.530 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:42:40.552 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.553 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:42:40.573 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.573 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:42:40.575 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.576 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:42:40.599 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.600 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:42:40.623 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.624 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:42:40.628 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.629 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:42:40.636 INFO 9 --- [prometheus-minute-schedule-1,d43b72594a07cdd6,1d079c8eaa914b98] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:40.639 INFO 9 --- [prometheus-minute-schedule-1,d43b72594a07cdd6,1d079c8eaa914b98] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:40.653 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.654 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:42:40.677 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.678 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:42:40.698 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.699 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:42:40.699 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.700 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:42:40.701 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.702 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:42:40.703 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.703 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:42:40.704 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.705 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:42:40.705 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.706 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:42:40.720 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.721 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:42:40.722 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.723 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:42:40.723 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.724 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:42:40.740 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:42:40.742 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:42:40.749 WARN 9 --- [ocp-async-8,2d90158a9d631928,4afccdea0827de95] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:40.749 INFO 9 --- [ocp-async-4,cd733cd472545808,8af667d1030f5e70] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:40.769 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:42:40.771 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:40.771 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:42:40.798 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:42:40.798 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:42:40.798 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:42:40.798 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:42:40.798 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:42:40.798 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:42:40.800 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:42:40.800 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:42:40.800 INFO 9 --- [ocp-schedules-26,d8fa3f2f625d0d08,9a015b3532750a50] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:42:41.676 INFO 9 --- [ocp-schedules-5,2bf6b4f67d907d8e,fcef2b87b76b68ae] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:42:41.676 INFO 9 --- [ocp-schedules-5,2bf6b4f67d907d8e,fcef2b87b76b68ae] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:42:41.710 INFO 9 --- [ocp-schedules-5,2bf6b4f67d907d8e,fcef2b87b76b68ae] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:41.711 INFO 9 --- [ocp-schedules-5,2bf6b4f67d907d8e,fcef2b87b76b68ae] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 13:42:41,862 |-INFO in ReconfigureOnChangeTask(born:1758001241862) - Empty watch file list. Disabling 2025-09-16 13:42:42.348 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:42.349 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:42.749 WARN 9 --- [ocp-async-5,daf792b45332f813,ab94992608fd18c5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:42.749 INFO 9 --- [ocp-async-6,02a9a5aabc5aa331,631408adaa8e60b3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:43.636 INFO 9 --- [prometheus-minute-schedule-1,3b7d9247f50b073e,bed7daf5de229d57] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:43.640 INFO 9 --- [prometheus-minute-schedule-1,3b7d9247f50b073e,bed7daf5de229d57] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:44.524 INFO 9 --- [ocp-schedules-4,e520d7483c1d7540,e4c393da10ebf4c8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:42:44.749 WARN 9 --- [ocp-async-10,417aa47d67bee30f,df2a820592cbdced] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:44.749 INFO 9 --- [ocp-async-7,7f615425dc6eb041,1092eb4b926bfd8d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:45.349 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:45.349 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:46.636 INFO 9 --- [prometheus-minute-schedule-1,2679998c146eb0e5,35a291cd951ef2fb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:46.640 INFO 9 --- [prometheus-minute-schedule-1,2679998c146eb0e5,35a291cd951ef2fb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:46.749 WARN 9 --- [ocp-async-9,e1876b97c225b4d5,9a953f7fe681475b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:46.749 INFO 9 --- [ocp-async-1,c8c8a1937fab4a90,8b8e17af7df51209] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:48.350 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:48.350 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:48.591 INFO 9 --- [ocp-schedules-15,22bfde71805f26e6,43ca2e018637b095] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:42:48.593 INFO 9 --- [ocp-schedules-15,22bfde71805f26e6,43ca2e018637b095] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:42:48.749 WARN 9 --- [ocp-async-4,7159f131a7137eef,d7202f2252814ca9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:48.749 INFO 9 --- [ocp-async-2,8e7b9f7e70c3479f,ce5290905eea39d5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:48.957 INFO 9 --- [ocp-schedules-28,1eb5bdf221d572c8,b504c960261445fe] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:42:48.962 WARN 9 --- [scanner-1355599-1,1eb5bdf221d572c8,b48f7836e7dcaf44] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:42:49.223 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:42:49.237 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:42:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:42:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:42:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:42:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:42:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:42:49.255 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:49.256 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:49.257 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:49.257 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:42:49.258 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:42:49.278 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:40:30, start=2025-09-16T13:37:30, end=2025-09-16T13:40:00, updates=78, granule=120000ms, delay=180000ms 2025-09-16 13:42:49.278 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:40:30, start=2025-09-16T13:37:30, end=2025-09-16T13:40:00, updates=70, granule=120000ms, delay=180000ms 2025-09-16 13:42:49.283 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:40:30, start=2025-09-16T13:37:30, end=2025-09-16T13:40:00, updates=136, granule=120000ms, delay=180000ms 2025-09-16 13:42:49.284 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:40:30, target=2025-09-16T13:40:00, granule=120000ms, delay=30000ms) 2025-09-16 13:42:49.285 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:40:00, target=2025-09-16T13:27:30, granule=600000ms, delay=750000ms) 2025-09-16 13:42:49.285 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:40:30, target=2025-09-16T13:40:00, granule=120000ms, delay=30000ms) 2025-09-16 13:42:49.285 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:40:00, target=2025-09-16T13:27:30, granule=600000ms, delay=750000ms) 2025-09-16 13:42:49.285 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:40:30, start=2025-09-16T13:37:30, end=2025-09-16T13:40:00, updates=137, granule=120000ms, delay=180000ms 2025-09-16 13:42:49.288 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:40:30, target=2025-09-16T13:40:00, granule=120000ms, delay=30000ms) 2025-09-16 13:42:49.288 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:40:00, target=2025-09-16T13:27:30, granule=600000ms, delay=750000ms) 2025-09-16 13:42:49.288 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:40:30, start=2025-09-16T13:37:30, end=2025-09-16T13:40:00, updates=194, granule=120000ms, delay=180000ms 2025-09-16 13:42:49.289 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:40:30, target=2025-09-16T13:40:00, granule=120000ms, delay=30000ms) 2025-09-16 13:42:49.289 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:40:00, target=2025-09-16T13:27:30, granule=600000ms, delay=750000ms) 2025-09-16 13:42:49.293 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:40:30, target=2025-09-16T13:40:00, granule=120000ms, delay=30000ms) 2025-09-16 13:42:49.293 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:40:00, target=2025-09-16T13:27:30, granule=600000ms, delay=750000ms) 2025-09-16 13:42:49.293 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=70ms, period=120000ms 2025-09-16 13:42:49.636 INFO 9 --- [prometheus-minute-schedule-1,5c2fdcb32f1886f1,156ed5312762aa29] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:49.640 INFO 9 --- [prometheus-minute-schedule-1,5c2fdcb32f1886f1,156ed5312762aa29] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:42:50.003844+08:00, lastProcessTime=2025-09-16T13:42:40.005957+08:00 2025-09-16 13:42:50.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:42:50.003844+08:00 2025-09-16 13:42:50.175 INFO 9 --- [ocp-async-9,606ed28f8be252b1,6fee700211e92d27] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:42:50.749 WARN 9 --- [ocp-async-10,d2da6a50dabda4f9,70d69a5b017ced0a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:50.750 INFO 9 --- [ocp-async-7,34a31bad6e5164d2,2d7fa424ab836b1c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:51.350 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:51.351 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:52.636 INFO 9 --- [prometheus-minute-schedule-1,b2dfe09bb9fb702a,69e53badd2e764af] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:52.639 INFO 9 --- [prometheus-minute-schedule-1,b2dfe09bb9fb702a,69e53badd2e764af] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:52.750 WARN 9 --- [ocp-async-9,8d57d9f43311631f,9f20b20e7080cd8e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:52.750 INFO 9 --- [ocp-async-1,d5c6f669536a3092,c18ed431218d91e4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:54.351 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:54.351 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:54.414 INFO 9 --- [ocp-schedules-9,ef910611330bd21f,7f2be1bda39fb5e7] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:42:54.419 INFO 9 --- [ocp-schedules-9,ef910611330bd21f,7f2be1bda39fb5e7] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:42:54.419 INFO 9 --- [ocp-schedules-9,ef910611330bd21f,7f2be1bda39fb5e7] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:42:54.528 INFO 9 --- [ocp-schedules-13,5fc6145dd3e9095d,0a5efffb0a28c6f8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:42:54.750 WARN 9 --- [ocp-async-4,8fff6c77e4e5e0cd,b64c05fa9a98dae5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:54.750 INFO 9 --- [ocp-async-4,e5ad67e0b6908c26,8b3841935f082ddc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:55.636 INFO 9 --- [prometheus-minute-schedule-1,f103ce36dff320e7,96f4f50392a6d00f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:55.640 INFO 9 --- [prometheus-minute-schedule-1,f103ce36dff320e7,96f4f50392a6d00f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:56.750 WARN 9 --- [ocp-async-6,e7876184bdf400be,223dd7aa76aa6f43] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:56.750 INFO 9 --- [ocp-async-3,f91f4ab72a82e064,c163f93fb6a13f75] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:57.352 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:42:57.352 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:42:58.597 INFO 9 --- [ocp-schedules-24,759b3d227ce18334,34cb3d0ac5081bac] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:42:58.599 INFO 9 --- [ocp-schedules-24,759b3d227ce18334,34cb3d0ac5081bac] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:42:58.636 INFO 9 --- [prometheus-minute-schedule-1,b5fdb593d608bb7c,ead1ea23046e5ba1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001380, interval=60 2025-09-16 13:42:58.639 INFO 9 --- [prometheus-minute-schedule-1,b5fdb593d608bb7c,ead1ea23046e5ba1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:42:58.750 WARN 9 --- [ocp-async-7,25350f8cd4444717,a760380ad54d0391] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:42:58.750 INFO 9 --- [ocp-async-8,ecd02b24ae9d2b07,08c48a690d4d4ec0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:42:58.985 INFO 9 --- [ocp-schedules-23,2233683924f573ad,82a6e09e93469507] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:42:58.991 WARN 9 --- [scanner-1355735-1,2233683924f573ad,74d1492f1a55c166] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:42:59.000 INFO 9 --- [alarm-detect-4,2233683924f573ad,adc04552aec63410] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 34, data is empty. 2025-09-16 13:42:59.002 INFO 9 --- [alarm-detect-11,2233683924f573ad,c8aaf792620a5fc9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 34, data is empty. 2025-09-16 13:42:59.003 INFO 9 --- [alarm-detect-5,2233683924f573ad,1aa57e333d3d52f0] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 34, data is empty. 2025-09-16 13:42:59.015 INFO 9 --- [alarm-detect-18,2233683924f573ad,efe93e5de58a287f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 34, data is empty. 2025-09-16 13:42:59.938 INFO 9 --- [ocp-schedules-20,918f8cfd4b5be064,4c2d4a3b85e7757c] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:42:59.941 INFO 9 --- [ocp-schedules-6,0f354c04d031b4cd,28c2521bab4b7d1e] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:42:59.941 INFO 9 --- [ocp-schedules-11,d3d857df9c55d605,29c7a3a74c3413d6] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:42:59.942 INFO 9 --- [ocp-schedules-20,12c044d4c723f72e,8d2f0f19f255555e] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:42:59.942 INFO 9 --- [ocp-schedules-11,d3d857df9c55d605,29c7a3a74c3413d6] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:59.943 INFO 9 --- [ocp-schedules-6,0f354c04d031b4cd,28c2521bab4b7d1e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:59.943 INFO 9 --- [ocp-schedules-20,12c044d4c723f72e,8d2f0f19f255555e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:42:59.944 INFO 9 --- [ocp-schedules-20,12c044d4c723f72e,8d2f0f19f255555e] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:42:59.944 INFO 9 --- [ocp-schedules-24,11650a80aa3108ca,d5c5f8f175a22e96] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:42:59.944 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:42:59.944 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:42:59.944 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:42:59.944 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:42:59.944 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:42:59.944 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:42:59.946 INFO 9 --- [ocp-schedules-26,420f4c2addc43160,73766c8611f47325] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:42:59.946 INFO 9 --- [ocp-schedules-1,31c90df72e588a3b,9b2ff946605807df] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:42:59.946 INFO 9 --- [host-check-clockdiff1,420f4c2addc43160,fc40419741698112] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:42:59.946 INFO 9 --- [host-check-clockdiff2,420f4c2addc43160,f43fd1ef4cccc0c0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:42:59.946 INFO 9 --- [host-check-clockdiff3,420f4c2addc43160,78644698ce3d4f5a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:42:59.946 INFO 9 --- [host-check-clockdiff4,420f4c2addc43160,ab927447190f0476] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:42:59.946 INFO 9 --- [host-check-agent-status1,31c90df72e588a3b,98a988f40006416f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:42:59.946 INFO 9 --- [host-check-clockdiff5,420f4c2addc43160,d8d18377ed526fc3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:42:59.946 INFO 9 --- [host-check-clockdiff6,420f4c2addc43160,7b1a2713cb75e932] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:42:59.946 INFO 9 --- [host-check-agent-status2,31c90df72e588a3b,7af1135472e53049] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:42:59.946 INFO 9 --- [host-check-agent-status3,31c90df72e588a3b,207ec33e62082566] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:42:59.946 INFO 9 --- [host-check-agent-status4,31c90df72e588a3b,6b3c12fe0c89340c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:42:59.946 INFO 9 --- [host-check-agent-status5,31c90df72e588a3b,0e22832b785dae27] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:42:59.946 INFO 9 --- [host-check-agent-status6,31c90df72e588a3b,4e9396c351d0e363] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:42:59.948 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:42:59.948 INFO 9 --- [ocp-schedules-27,28c7c0bda11f35c3,7ff789cb7d7f43c7] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:42:59.952 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:42:59.954 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:42:59.954 INFO 9 --- [host-check-clockdiff3,420f4c2addc43160,78644698ce3d4f5a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001379 -1 -1 , error= 2025-09-16 13:42:59.955 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:42:59.955 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:59.955 INFO 9 --- [host-check-clockdiff4,420f4c2addc43160,ab927447190f0476] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001379 0 0 , error= 2025-09-16 13:42:59.955 INFO 9 --- [host-check-clockdiff6,420f4c2addc43160,7b1a2713cb75e932] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001379 -1 -1 , error= 2025-09-16 13:42:59.955 INFO 9 --- [host-check-agent-status3,31c90df72e588a3b,207ec33e62082566] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:42:59.956 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:42:59.956 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:42:59.956 INFO 9 --- [host-check-agent-status2,31c90df72e588a3b,7af1135472e53049] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:42:59.956 INFO 9 --- [host-check-agent-status5,31c90df72e588a3b,0e22832b785dae27] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:42:59.956 INFO 9 --- [host-check-clockdiff2,420f4c2addc43160,f43fd1ef4cccc0c0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001379 -1 -1 , error= 2025-09-16 13:42:59.956 INFO 9 --- [host-check-clockdiff1,420f4c2addc43160,fc40419741698112] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001379 0 0 , error= 2025-09-16 13:42:59.956 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:42:59.957 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:42:59.957 INFO 9 --- [host-check-agent-status1,31c90df72e588a3b,98a988f40006416f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:42:59.957 INFO 9 --- [host-check-agent-status4,31c90df72e588a3b,6b3c12fe0c89340c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:42:59.957 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:59.957 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:42:59.958 INFO 9 --- [host-check-agent-status1,31c90df72e588a3b,98a988f40006416f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:42:59.958 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:42:59.958 INFO 9 --- [host-check-agent-status2,31c90df72e588a3b,7af1135472e53049] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:42:59.958 INFO 9 --- [host-check-agent-status3,31c90df72e588a3b,207ec33e62082566] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:42:59.958 INFO 9 --- [host-check-agent-status4,31c90df72e588a3b,6b3c12fe0c89340c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:42:59.958 INFO 9 --- [host-check-agent-status5,31c90df72e588a3b,0e22832b785dae27] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:42:59.958 INFO 9 --- [host-check-agent-status6,31c90df72e588a3b,4e9396c351d0e363] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:59.960 INFO 9 --- [host-check-agent-status6,31c90df72e588a3b,4e9396c351d0e363] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:59.972 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:42:59.972 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:42:59.973 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:42:59.973 INFO 9 --- [host-check-agent-status1,31c90df72e588a3b,98a988f40006416f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:42:59.973 INFO 9 --- [host-check-agent-status4,31c90df72e588a3b,6b3c12fe0c89340c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:42:59.973 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:42:59.973 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:42:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:59.973 INFO 9 --- [host-check-agent-status2,31c90df72e588a3b,7af1135472e53049] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:42:59.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:42:59.974 INFO 9 --- [host-check-agent-status5,31c90df72e588a3b,0e22832b785dae27] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:42:59.974 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:42:59.974 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:42:59.973180781+08:00 2025-09-16 13:42:59.974 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:42:59.973652874+08:00 2025-09-16 13:42:59.974 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:42:59.973569051+08:00 2025-09-16 13:42:59.974 INFO 9 --- [host-check-agent-status3,31c90df72e588a3b,207ec33e62082566] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:42:59.974 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:42:59.974+08:00 2025-09-16 13:42:59.974 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:42:59.973676871+08:00 2025-09-16 13:42:59.975 INFO 9 --- [host-check-agent-status6,31c90df72e588a3b,4e9396c351d0e363] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:42:59.975 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:42:59.974+08:00 2025-09-16 13:42:59.975 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:42:59.973700748+08:00 2025-09-16 13:42:59.975 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:42:59.974+08:00 2025-09-16 13:42:59.975 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:42:59.975+08:00 2025-09-16 13:42:59.975 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:42:59.974518046+08:00 2025-09-16 13:42:59.975 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:42:59.975+08:00 2025-09-16 13:42:59.975 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:42:59.975+08:00 2025-09-16 13:42:59.976 INFO 9 --- [host-check-agent-status1,31c90df72e588a3b,98a988f40006416f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:42:59.976 INFO 9 --- [host-check-agent-status1,31c90df72e588a3b,98a988f40006416f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:42:59.976 INFO 9 --- [host-check-agent-status1,31c90df72e588a3b,98a988f40006416f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:42:59.976 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:42:59.974+08:00 and status AVAILABLE 2025-09-16 13:42:59.976 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:42:59.974+08:00 and status AVAILABLE 2025-09-16 13:42:59.976 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:42:59.974+08:00 and status AVAILABLE 2025-09-16 13:42:59.976 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:42:59.975+08:00 and status AVAILABLE 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status4,31c90df72e588a3b,6b3c12fe0c89340c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:42:59.977 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:42:59.975+08:00 and status AVAILABLE 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status4,31c90df72e588a3b,6b3c12fe0c89340c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status4,31c90df72e588a3b,6b3c12fe0c89340c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status2,31c90df72e588a3b,7af1135472e53049] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status2,31c90df72e588a3b,7af1135472e53049] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status2,31c90df72e588a3b,7af1135472e53049] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:42:59.977 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:42:59.975+08:00 and status AVAILABLE 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status3,31c90df72e588a3b,207ec33e62082566] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status3,31c90df72e588a3b,207ec33e62082566] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status3,31c90df72e588a3b,207ec33e62082566] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:42:59.977 INFO 9 --- [host-check-agent-status6,31c90df72e588a3b,4e9396c351d0e363] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:42:59.978 INFO 9 --- [host-check-agent-status6,31c90df72e588a3b,4e9396c351d0e363] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:42:59.978 INFO 9 --- [host-check-agent-status6,31c90df72e588a3b,4e9396c351d0e363] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:42:59.978 INFO 9 --- [host-check-agent-status5,31c90df72e588a3b,0e22832b785dae27] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:42:59.978 INFO 9 --- [host-check-agent-status5,31c90df72e588a3b,0e22832b785dae27] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:42:59.978 INFO 9 --- [host-check-agent-status5,31c90df72e588a3b,0e22832b785dae27] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:42:59.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:42:59.979 INFO 9 --- [ocp-schedules-11,d3d857df9c55d605,29c7a3a74c3413d6] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:42:59.979 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:42:59.981 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:42:59.981 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:42:59.981 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:42:59.981 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:42:59.981 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:42:59.985 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:42:59.986 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:42:59.986 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:42:59.986 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:42:59.986 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:42:59.987 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:42:59.987 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:42:59.987 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:42:59.987 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:42:59.987 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:42:59.987 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:42:59.988 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:42:59.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:42:59.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:43:00.000 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:00.001 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:00.002 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:00.002 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:00.002 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:00.002 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:00.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:43:00.004844+08:00, lastProcessTime=2025-09-16T13:42:50.003844+08:00 2025-09-16 13:43:00.028 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:43:00.029 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:43:00.030 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:43:00.030 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:43:00.033 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:00.034 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:43:00.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:00.035 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:43:00.035 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:43:00.035 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:43:00.036 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:43:00.036 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:43:00.037 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:43:00.042 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:43:00.042 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:43:00.046 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:00.047 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:00.048 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:00.048 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:00.053 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:00.055 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:00.070 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:00.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:43:00.075 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:00.075 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:43:00.076 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:43:00.077 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:43:00.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:43:00.079 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:00.081 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:43:00.082 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:43:00.082 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:43:00.082 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:43:00.083 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:43:00.085 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:43:00.087 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:43:00.089 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:43:00.091 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:43:00.094 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:00.094 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.094 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:00.095 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:00.096 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:00.099 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:00.100 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:00.101 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:00.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:00.121 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:43:00.121 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:43:00.125 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:43:00.126 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.126 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:00.127 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:43:00.127 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:43:00.128 INFO 9 --- [host-check-host-status3,11650a80aa3108ca,eaea1299d19da8ac] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:43:00.128 INFO 9 --- [host-check-host-status5,11650a80aa3108ca,415d2167b2684294] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:43:00.129 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:43:00.132 INFO 9 --- [host-check-host-status6,11650a80aa3108ca,0c31e721c6c725e1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:43:00.133 INFO 9 --- [host-check-host-status2,11650a80aa3108ca,6c97f84abdc0c82a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:43:00.134 INFO 9 --- [host-check-host-status1,11650a80aa3108ca,584b2b81b4a1fc63] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:43:00.136 INFO 9 --- [host-check-host-status4,11650a80aa3108ca,a094e1a5f1d1a42f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:43:00.136 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:43:00.004844+08:00 2025-09-16 13:43:00.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:00.160 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.160 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:00.175 INFO 9 --- [ocp-async-6,7736e63797a903a6,c7148afd33823c51] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:43:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:00.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:00.233 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:00.247 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:00.248 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:00.249 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:43:00.254 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:43:00.257 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:43:00.260 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:00.274 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:43:00.335 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:43:00.349 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:00.351 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:00.351 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:43:00.352 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:00.353 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:43:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:43:00.366 INFO 9 --- [ocp-schedules-6,0f354c04d031b4cd,28c2521bab4b7d1e] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:43:00.750 WARN 9 --- [ocp-async-2,a29ad2187bc9fac2,04a86cb7a835764c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:00.750 INFO 9 --- [ocp-async-4,bdd2a913962d32a6,33f0e7992c8f9fc3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:00.799 INFO 9 --- [ocp-schedules-9,4aa6d68094c124e3,da110d5b14b95fa5] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:43:00.887 INFO 9 --- [host-check-clockdiff5,420f4c2addc43160,d8d18377ed526fc3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001380 -1 -1 , error= 2025-09-16 13:43:01.636 INFO 9 --- [prometheus-minute-schedule-1,ccaec2bfe72d4383,f67206bfd836d27a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:01.640 INFO 9 --- [prometheus-minute-schedule-1,ccaec2bfe72d4383,f67206bfd836d27a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:02.750 WARN 9 --- [ocp-async-6,42842b821d761a5f,a1f0e61590a2ef89] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:02.750 INFO 9 --- [ocp-async-3,7fa1130d4bac3c88,0abcf4fa4cba057b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:03.353 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:03.353 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:04.531 INFO 9 --- [ocp-schedules-11,2926368272b0a44d,28d8c57ec358e029] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:43:04.636 INFO 9 --- [prometheus-minute-schedule-1,413abffa9eb4b6ac,a664519c559784d7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:04.639 INFO 9 --- [prometheus-minute-schedule-1,413abffa9eb4b6ac,a664519c559784d7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:04.750 WARN 9 --- [ocp-async-7,f334519b964bc761,0bcf275ab6508766] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:04.750 INFO 9 --- [ocp-async-8,8d99782bc076362c,d6ac00525be86f7b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:06.353 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:06.354 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:06.750 WARN 9 --- [ocp-async-2,ff27634857ff6a31,4a1b8a224254f7c2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:06.750 INFO 9 --- [ocp-async-5,bdf6abe4f1bb3459,91050181aab00a65] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:07.636 INFO 9 --- [prometheus-minute-schedule-1,87d829521638ef0d,a8963c5886282429] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:07.640 INFO 9 --- [prometheus-minute-schedule-1,87d829521638ef0d,a8963c5886282429] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:08.604 INFO 9 --- [ocp-schedules-20,095daafeb95b6ef8,0a46383a29816d53] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:43:08.606 INFO 9 --- [ocp-schedules-20,095daafeb95b6ef8,0a46383a29816d53] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:43:08.751 WARN 9 --- [ocp-async-6,6707961269f48311,c00d42a033a0cb46] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:08.751 INFO 9 --- [ocp-async-10,e02ccb4dc3f69182,9140cd6033db4f1f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:09.017 INFO 9 --- [ocp-schedules-7,bdc9bd73616faf61,4c6e62e5ec932df4] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:43:09.022 WARN 9 --- [scanner-1355904-1,bdc9bd73616faf61,28936b3fc35a440e] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:43:09.354 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:09.355 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:10.002 INFO 9 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:43:10.003 INFO 9 --- [ocp-schedules-20,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:43:10.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:43:10.005212+08:00, lastProcessTime=2025-09-16T13:43:00.004844+08:00 2025-09-16 13:43:10.112 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:43:10.005212+08:00 2025-09-16 13:43:10.175 INFO 9 --- [ocp-async-2,492dcfee3211c8d7,7a1f585561a98d4e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:43:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:43:10.636 INFO 9 --- [prometheus-minute-schedule-1,db1f736fa6eec35e,3db2ee07fc4b64d3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:10.639 INFO 9 --- [prometheus-minute-schedule-1,db1f736fa6eec35e,3db2ee07fc4b64d3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:10.751 WARN 9 --- [ocp-async-9,b7108ac25f38a651,546da4fb6d3e7116] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:10.751 INFO 9 --- [ocp-async-8,5826c8e1911da1f7,c92bb9f262452998] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:11.671 INFO 9 --- [metric-archive-async-1,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001320, nodeCount=171, affectRows=171 2025-09-16 13:43:11.674 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001320, nodeCount=292, affectRows=292 2025-09-16 13:43:12.355 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:12.355 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:12.751 WARN 9 --- [ocp-async-2,6c0817cc73891837,41f0af4bb67502ae] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:12.751 INFO 9 --- [ocp-async-5,0e0d9efecd3b5a80,3a8eb00ef11d0d8c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:13.636 INFO 9 --- [prometheus-minute-schedule-1,6c086ccce0db98b4,c2e3a93c1ac335c0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:13.640 INFO 9 --- [prometheus-minute-schedule-1,6c086ccce0db98b4,c2e3a93c1ac335c0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:14.397 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001320, nodeCount=1000, affectRows=1000 2025-09-16 13:43:14.400 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001320, nodeCount=1000, validCount=996 2025-09-16 13:43:14.420 INFO 9 --- [ocp-schedules-3,8aed088c55450558,6d37cc375f626311] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:43:14.425 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001320, nodeCount=1000, affectRows=1000 2025-09-16 13:43:14.426 INFO 9 --- [ocp-schedules-3,8aed088c55450558,6d37cc375f626311] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:43:14.426 INFO 9 --- [ocp-schedules-3,8aed088c55450558,6d37cc375f626311] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:43:14.427 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001320, nodeCount=1000, validCount=998 2025-09-16 13:43:14.438 ERROR 9 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221682509) Duplicate entry '824401952549289984-1758001260' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221682509) Duplicate entry '824401952549289984-1758001260' for key 'PRIMARY' 2025-09-16 13:43:14.535 INFO 9 --- [ocp-schedules-8,a756973a4a9b8235,08d54fc9825b433a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:43:14.751 WARN 9 --- [ocp-async-6,9246cfe21a6deba1,aaff5d12a0f99019] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:14.751 INFO 9 --- [ocp-async-10,b6dcbf1348aab554,aa03b94c4db480a2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:15.355 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:15.356 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:15.389 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001320, nodeCount=302, affectRows=302 2025-09-16 13:43:15.389 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001320, nodeCount=274, affectRows=274 2025-09-16 13:43:15.389 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001320, nodeCount=277, affectRows=277 2025-09-16 13:43:15.390 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001320, nodeCount=274, validCount=274 2025-09-16 13:43:15.390 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001320, nodeCount=302, validCount=300 2025-09-16 13:43:15.390 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001320, nodeCount=277, validCount=276 2025-09-16 13:43:15.705 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001320, nodeCount=1000, affectRows=1000 2025-09-16 13:43:15.707 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001320, nodeCount=993, validCount=948 2025-09-16 13:43:16.636 INFO 9 --- [prometheus-minute-schedule-1,fa55663653330764,653f874ea4f6a1a0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:16.640 INFO 9 --- [prometheus-minute-schedule-1,fa55663653330764,653f874ea4f6a1a0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:16.751 WARN 9 --- [ocp-async-3,41ed79713b90baef,4e18cf7c9deff7da] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:16.751 INFO 9 --- [ocp-async-7,a5de8ad2cc88e86b,775e12feba034298] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:18.356 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:18.357 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:18.611 INFO 9 --- [ocp-schedules-23,7bfdf8d2ba8ebbd2,83a0c05b87435f26] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:43:18.618 INFO 9 --- [ocp-schedules-23,7bfdf8d2ba8ebbd2,83a0c05b87435f26] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:43:18.751 WARN 9 --- [ocp-async-8,1e87864b344d4a27,8e3a38e3cacb3741] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:18.751 INFO 9 --- [ocp-async-1,1d8682d1dea38952,e46435427a6315a0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:19.043 INFO 9 --- [ocp-schedules-5,52f2f7c2f86fe668,a041dcff762cda78] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:43:19.048 WARN 9 --- [scanner-1356896-1,52f2f7c2f86fe668,f900f2407fb061a1] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:43:19.058 INFO 9 --- [alarm-detect-19,52f2f7c2f86fe668,f7cbd5f2805a794e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 34, data is empty. 2025-09-16 13:43:19.060 INFO 9 --- [alarm-detect-9,52f2f7c2f86fe668,7b0096a520908a41] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 34, data is empty. 2025-09-16 13:43:19.060 INFO 9 --- [alarm-detect-7,52f2f7c2f86fe668,62454ea126f3b023] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 34, data is empty. 2025-09-16 13:43:19.073 INFO 9 --- [alarm-detect-17,52f2f7c2f86fe668,285f1014e20341b9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 34, data is empty. 2025-09-16 13:43:19.636 INFO 9 --- [prometheus-minute-schedule-1,cbbf26583bcae0c1,cade7a83e9082938] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:19.639 INFO 9 --- [prometheus-minute-schedule-1,cbbf26583bcae0c1,cade7a83e9082938] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:43:20.002889+08:00, lastProcessTime=2025-09-16T13:43:10.005212+08:00 2025-09-16 13:43:20.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:43:20.002889+08:00 2025-09-16 13:43:20.175 INFO 9 --- [ocp-async-3,fa4677bfe441db18,af7bc6ec09a5d753] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:43:20.636 INFO 9 --- [prometheus-cache-monitor1,40d2ea1977115e6c,f73c270c02d82321] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:43:20.636 INFO 9 --- [prometheus-cache-monitor1,40d2ea1977115e6c,f73c270c02d82321] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:43:20.751 WARN 9 --- [ocp-async-6,74443852a2d5f658,781fd1adf51559f2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:20.751 INFO 9 --- [ocp-async-10,c26d4261b6816648,0249bad43a6cf64f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:21.357 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:21.357 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:22.068 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,8f2b95725f4b28df,a95e10cb9132f57c] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=8f2b95725f4b28df, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:43:22.069 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,8f2b95725f4b28df,a95e10cb9132f57c] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=8f2b95725f4b28df, duration=1 ms] 2025-09-16 13:43:22.636 INFO 9 --- [prometheus-minute-schedule-1,8dc66daff46de6c0,a5b2cccba722fd9a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:22.639 INFO 9 --- [prometheus-minute-schedule-1,8dc66daff46de6c0,a5b2cccba722fd9a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:22.751 WARN 9 --- [ocp-async-9,8903b6966003286f,70884d17c05a5952] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:22.751 INFO 9 --- [ocp-async-7,ac3f5d5889e46ee9,83c7eba6a34bdec4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:24.357 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:24.358 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:24.539 INFO 9 --- [ocp-schedules-9,349791fcdc20d643,e65adfdb9c6217a0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:43:24.751 WARN 9 --- [ocp-async-2,e596339cfcd70ba6,fe49133cc2f403e1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:24.752 INFO 9 --- [ocp-async-1,54af6a980c87ff9b,f204a4de961125ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:25.636 INFO 9 --- [prometheus-minute-schedule-1,6ff59e28845f2ff7,b1c90162a173765b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:25.639 INFO 9 --- [prometheus-minute-schedule-1,6ff59e28845f2ff7,b1c90162a173765b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:26.752 WARN 9 --- [ocp-async-6,2292d7fb06a0fab0,89af5e7005974a9d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:26.752 INFO 9 --- [ocp-async-4,89cf9ba7e2c805aa,0a5eb1e2fb295f6b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:27.358 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:27.359 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:28.623 INFO 9 --- [ocp-schedules-17,ebf171dbca0b7bc9,f8b6142e8c97493a] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:43:28.625 INFO 9 --- [ocp-schedules-17,ebf171dbca0b7bc9,f8b6142e8c97493a] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:43:28.636 INFO 9 --- [prometheus-minute-schedule-1,525361cf21c4e660,91256558e86c0e5a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:28.639 INFO 9 --- [prometheus-minute-schedule-1,525361cf21c4e660,91256558e86c0e5a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:28.752 WARN 9 --- [ocp-async-9,f570aa588cdee8dc,9f21fe52526ff4a7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:28.752 INFO 9 --- [ocp-async-3,88f0fff1e416b4f7,576a847633eb1aac] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:29.075 INFO 9 --- [ocp-schedules-30,862c4aeac07b53b2,0a56562e0278ce25] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:43:29.080 WARN 9 --- [scanner-1357062-1,862c4aeac07b53b2,d42ff71177fcdd2c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:43:29.938 INFO 9 --- [ocp-schedules-13,c1e3585ccb1a7be9,a513d9f155c84111] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:43:29.941 INFO 9 --- [ocp-schedules-16,dc67b9c555004baa,46f1412293a8cdbc] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:43:29.941 INFO 9 --- [ocp-schedules-5,827516a877ba3700,87567b2623cff1df] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:43:29.942 INFO 9 --- [ocp-schedules-14,7d85ff39124fbd50,ed19086532e991ce] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:43:29.942 INFO 9 --- [ocp-schedules-5,827516a877ba3700,87567b2623cff1df] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:29.943 INFO 9 --- [ocp-schedules-16,dc67b9c555004baa,46f1412293a8cdbc] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:29.943 INFO 9 --- [ocp-schedules-14,7d85ff39124fbd50,ed19086532e991ce] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:29.943 INFO 9 --- [ocp-schedules-14,7d85ff39124fbd50,ed19086532e991ce] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:43:29.944 INFO 9 --- [ocp-schedules-9,bbe032db85dc2fad,562cf8b22197c6c3] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:43:29.944 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:43:29.944 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [ocp-schedules-19,050f21793bd4dede,2e4010fa4413fc92] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:43:29.945 INFO 9 --- [ocp-schedules-18,33b80fbd2f693444,0a9c636e42e8deb3] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:43:29.945 INFO 9 --- [host-check-agent-status1,050f21793bd4dede,df0932d97e558212] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-clockdiff1,33b80fbd2f693444,a24eeedc2a1646e7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:43:29.945 INFO 9 --- [host-check-agent-status2,050f21793bd4dede,419454c2d1f34019] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-agent-status3,050f21793bd4dede,e0a70c23d40865b7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-agent-status4,050f21793bd4dede,376ffef2f12abe0d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:43:29.945 INFO 9 --- [host-check-clockdiff2,33b80fbd2f693444,70bd58710181df9b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:43:29.945 INFO 9 --- [host-check-clockdiff3,33b80fbd2f693444,adf2f67769e9d16a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:43:29.945 INFO 9 --- [host-check-agent-status5,050f21793bd4dede,4bcb3a2d6d5113de] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:43:29.946 INFO 9 --- [host-check-clockdiff4,33b80fbd2f693444,b139aaa2f54cffe9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:43:29.946 INFO 9 --- [host-check-agent-status6,050f21793bd4dede,eb81df4e9a50ae6d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:43:29.946 INFO 9 --- [host-check-clockdiff5,33b80fbd2f693444,b632849a5aa6845f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:43:29.946 INFO 9 --- [host-check-clockdiff6,33b80fbd2f693444,adcc46fd16a2e0ce] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:43:29.948 INFO 9 --- [ocp-schedules-1,4b0eb5b86ed9fe7b,284617a9a44ebfae] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:43:29.952 INFO 9 --- [ocp-schedules-24,97bee88b2abe80d5,426f4f4612b25d9a] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2025-09-16 13:43:29.952 INFO 9 --- [host-check-clockdiff4,33b80fbd2f693444,b139aaa2f54cffe9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001409 -1 -1 , error= 2025-09-16 13:43:29.952 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:29.952 INFO 9 --- [host-check-clockdiff3,33b80fbd2f693444,adf2f67769e9d16a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001409 -1 -1 , error= 2025-09-16 13:43:29.953 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:29.953 INFO 9 --- [host-check-agent-status1,050f21793bd4dede,df0932d97e558212] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:29.953 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:29.953 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:29.953 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:29.953 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:29.953 INFO 9 --- [ocp-schedules-24,97bee88b2abe80d5,426f4f4612b25d9a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:29.953 INFO 9 --- [host-check-clockdiff5,33b80fbd2f693444,b632849a5aa6845f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001409 -1 -1 , error= 2025-09-16 13:43:29.954 INFO 9 --- [host-check-agent-status3,050f21793bd4dede,e0a70c23d40865b7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:29.954 INFO 9 --- [host-check-agent-status5,050f21793bd4dede,4bcb3a2d6d5113de] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:29.955 INFO 9 --- [host-check-clockdiff6,33b80fbd2f693444,adcc46fd16a2e0ce] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001409 -1 -1 , error= 2025-09-16 13:43:29.955 INFO 9 --- [host-check-agent-status6,050f21793bd4dede,eb81df4e9a50ae6d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:29.955 INFO 9 --- [host-check-agent-status4,050f21793bd4dede,376ffef2f12abe0d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:29.955 INFO 9 --- [host-check-agent-status2,050f21793bd4dede,419454c2d1f34019] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:29.955 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:29.955 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:29.955 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:29.955 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:43:29.955 INFO 9 --- [host-check-agent-status1,050f21793bd4dede,df0932d97e558212] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:29.955 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:29.955 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:29.955 INFO 9 --- [host-check-agent-status6,050f21793bd4dede,eb81df4e9a50ae6d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:29.956 INFO 9 --- [host-check-agent-status5,050f21793bd4dede,4bcb3a2d6d5113de] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:29.956 INFO 9 --- [host-check-agent-status3,050f21793bd4dede,e0a70c23d40865b7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:29.956 INFO 9 --- [host-check-agent-status4,050f21793bd4dede,376ffef2f12abe0d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:43:29.956 INFO 9 --- [host-check-agent-status2,050f21793bd4dede,419454c2d1f34019] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:29.962 INFO 9 --- [ocp-schedules-29,0ce142cf46d6a507,5b7cfa151fa3c870] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:43:29.963 INFO 9 --- [ocp-schedules-21,212e4e7d9c7d1bea,72f5451969828e0e] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:43:29.968 INFO 9 --- [ocp-schedules-29,0ce142cf46d6a507,5b7cfa151fa3c870] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:43:29.969 INFO 9 --- [ocp-schedules-21,212e4e7d9c7d1bea,72f5451969828e0e] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:43:29.970 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:43:29.970 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:43:29.970 INFO 9 --- [host-check-agent-status1,050f21793bd4dede,df0932d97e558212] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:43:29.970 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:43:29.970 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:43:29.970 INFO 9 --- [ocp-schedules-11,e92db43b8c883dd3,1120e4ad906dd9e3] c.o.o.s.common.scheduled.OcpSchedules : Cleanup ocp connection pools. 2025-09-16 13:43:29.970 INFO 9 --- [ocp-schedules-11,e92db43b8c883dd3,1120e4ad906dd9e3] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2025-09-16 13:43:29.971 INFO 9 --- [host-check-agent-status5,050f21793bd4dede,4bcb3a2d6d5113de] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:43:29.971 INFO 9 --- [host-check-agent-status4,050f21793bd4dede,376ffef2f12abe0d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:43:29.971 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:43:29.971 INFO 9 --- [host-check-agent-status2,050f21793bd4dede,419454c2d1f34019] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:43:29.971 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:43:29.973 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:43:29.971684991+08:00 2025-09-16 13:43:29.973 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:43:29.970797043+08:00 2025-09-16 13:43:29.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:43:29.973+08:00 2025-09-16 13:43:29.974 INFO 9 --- [host-check-agent-status6,050f21793bd4dede,eb81df4e9a50ae6d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:43:29.973119426+08:00 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:43:29.974+08:00 2025-09-16 13:43:29.974 INFO 9 --- [host-check-agent-status3,050f21793bd4dede,e0a70c23d40865b7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:43:29.973170060+08:00 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:43:29.973236423+08:00 2025-09-16 13:43:29.974 INFO 9 --- [host-check-agent-status1,050f21793bd4dede,df0932d97e558212] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:43:29.974 INFO 9 --- [host-check-agent-status1,050f21793bd4dede,df0932d97e558212] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:43:29.974 INFO 9 --- [host-check-agent-status1,050f21793bd4dede,df0932d97e558212] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:43:29.974+08:00 2025-09-16 13:43:29.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:43:29.974+08:00 2025-09-16 13:43:29.974 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:43:29.974+08:00 2025-09-16 13:43:29.975 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:43:29.974584355+08:00 2025-09-16 13:43:29.975 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:43:29.975+08:00 2025-09-16 13:43:29.976 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:43:29.974+08:00 and status AVAILABLE 2025-09-16 13:43:29.976 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:43:29.973+08:00 and status AVAILABLE 2025-09-16 13:43:29.976 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:43:29.974+08:00 and status AVAILABLE 2025-09-16 13:43:29.976 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:43:29.974+08:00 and status AVAILABLE 2025-09-16 13:43:29.976 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:43:29.974+08:00 and status AVAILABLE 2025-09-16 13:43:29.976 INFO 9 --- [host-check-agent-status2,050f21793bd4dede,419454c2d1f34019] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:43:29.976 INFO 9 --- [host-check-agent-status2,050f21793bd4dede,419454c2d1f34019] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:43:29.976 INFO 9 --- [host-check-agent-status2,050f21793bd4dede,419454c2d1f34019] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:43:29.977 INFO 9 --- [host-check-agent-status5,050f21793bd4dede,4bcb3a2d6d5113de] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:43:29.977 INFO 9 --- [host-check-agent-status5,050f21793bd4dede,4bcb3a2d6d5113de] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:43:29.977 INFO 9 --- [host-check-agent-status5,050f21793bd4dede,4bcb3a2d6d5113de] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:43:29.977 INFO 9 --- [host-check-agent-status3,050f21793bd4dede,e0a70c23d40865b7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:43:29.977 INFO 9 --- [host-check-agent-status3,050f21793bd4dede,e0a70c23d40865b7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:43:29.977 INFO 9 --- [host-check-agent-status3,050f21793bd4dede,e0a70c23d40865b7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:43:29.977 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:43:29.975+08:00 and status AVAILABLE 2025-09-16 13:43:29.977 INFO 9 --- [pool-overview-container-8,ce057096708bf0aa,364b2a6464de9721] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:43:29.978 INFO 9 --- [host-check-agent-status4,050f21793bd4dede,376ffef2f12abe0d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:43:29.978 INFO 9 --- [host-check-agent-status4,050f21793bd4dede,376ffef2f12abe0d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:43:29.978 INFO 9 --- [host-check-agent-status4,050f21793bd4dede,376ffef2f12abe0d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:43:29.978 INFO 9 --- [host-check-agent-status6,050f21793bd4dede,eb81df4e9a50ae6d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:43:29.978 INFO 9 --- [host-check-agent-status6,050f21793bd4dede,eb81df4e9a50ae6d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:43:29.978 INFO 9 --- [host-check-agent-status6,050f21793bd4dede,eb81df4e9a50ae6d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:43:29.978 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:29.979 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:43:29.979 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2025-09-16 13:43:29.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:43:29.979 INFO 9 --- [ocp-schedules-5,827516a877ba3700,87567b2623cff1df] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:43:29.980 INFO 9 --- [pool-overview-container-3,3ca39d324ceeecc5,d3c26b3009736dea] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:43:29.980 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:43:29.980 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:43:29.981 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:43:29.981 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:43:29.981 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:43:29.985 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:29.985 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:29.986 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:29.986 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:29.987 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:29.987 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:29.987 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:29.987 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:29.987 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:43:29.987 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:29.987 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:29.988 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:43:29.993 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,a3c65123e92dc81b,39e914f243c558cb] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=zhengqi&ObClusterId=1&version=2, client=10.232.140.0, traceId=a3c65123e92dc81b, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getRootServiceInfo(String,Long,String,Long,boolean,Integer), args=zhengqi,1,false,2,] 2025-09-16 13:43:29.993 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,a3c65123e92dc81b,39e914f243c558cb] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=a3c65123e92dc81b, duration=1 ms] 2025-09-16 13:43:29.993 INFO 9 --- [pool-12-thread-6,ce057096708bf0aa,648e965b6c9275ca] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to get cluster trans stat 2025-09-16 13:43:29.993 INFO 9 --- [pool-12-thread-8,ce057096708bf0aa,24496ab0203c3a1d] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get outline history 2025-09-16 13:43:29.994 INFO 9 --- [pool-12-thread-5,ce057096708bf0aa,16ec4cbe4eb9697e] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get Cluster Sql Stat 2025-09-16 13:43:29.994 INFO 9 --- [pool-12-thread-5,ce057096708bf0aa,16ec4cbe4eb9697e] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster slow Sql Stat 2025-09-16 13:43:29.994 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:29.994 INFO 9 --- [pool-12-thread-7,ce057096708bf0aa,55038cb5b5ca4552] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster session stat 2025-09-16 13:43:29.995 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2025-09-16 13:43:29.996 INFO 9 --- [ForkJoinPool-10-worker-11,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:43:29.997 INFO 9 --- [ForkJoinPool-10-worker-4,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:43:29.997 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get tenant session stat of zhengqi 2025-09-16 13:43:29.997 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get session of zhengqi 2025-09-16 13:43:29.998 INFO 9 --- [pool-12-thread-6,ce057096708bf0aa,648e965b6c9275ca] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to attach trans id 2025-09-16 13:43:29.998 INFO 9 --- [pool-12-thread-6,ce057096708bf0aa,648e965b6c9275ca] c.o.o.p.t.i.ObTransactionDiagServiceImpl : finish fetching trans data 2025-09-16 13:43:30.000 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:30.001 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:30.001 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:30.001 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:30.003 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:30.003 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:43:30.003 INFO 9 --- [pool-overview-container-4,d428869ffae69f3e,9f9eaa16b14cd19d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.005 INFO 9 --- [pool-overview-container-4,d428869ffae69f3e,9f9eaa16b14cd19d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ SVR_IP, SVR_PORT, ZONE, CPU_CAPACITY, CPU_CAPACITY_MAX, CPU_ASSIGNED, CPU_ASSIGNED_MAX, MEM_CAPACITY, MEM_CAPACITY AS MEM_CAPACITY_MAX, MEM_ASSIGNED, MEM_ASSIGNED AS MEM_ASSIGNED_MAX, LOG_DISK_CAPACITY, LOG_DISK_ASSIGNED, LOG_DISK_IN_USE, DATA_DISK_CAPACITY, DATA_DISK_IN_USE FROM oceanbase.GV$OB_SERVERS 2025-09-16 13:43:30.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:43:30.005670+08:00, lastProcessTime=2025-09-16T13:43:20.002889+08:00 2025-09-16 13:43:30.007 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.009 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.159, 2882] 2025-09-16 13:43:30.010 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.012 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.111, 2882] 2025-09-16 13:43:30.013 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.014 INFO 9 --- [pool-12-thread-5,ce057096708bf0aa,16ec4cbe4eb9697e] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster anomaly sql Stat 2025-09-16 13:43:30.015 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.104, 2882] 2025-09-16 13:43:30.016 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.018 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.85, 2882] 2025-09-16 13:43:30.019 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.021 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.54, 2882] 2025-09-16 13:43:30.021 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.022 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.022 INFO 9 --- [ocp-schedules-24,97bee88b2abe80d5,426f4f4612b25d9a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check root service executed completed, allCount=1, successCount=1 2025-09-16 13:43:30.022 INFO 9 --- [pool-12-thread-5,ce057096708bf0aa,16ec4cbe4eb9697e] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching cluster sql stat 2025-09-16 13:43:30.023 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:43:30.023 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:43:30.027 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.028 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:30.028 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:43:30.029 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:43:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:43:30.030 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:43:30.030 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:43:30.031 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:43:30.035 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:43:30.036 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:43:30.036 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:43:30.037 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:43:30.037 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:43:30.038 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:43:30.043 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:43:30.043 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:43:30.043 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:43:30.044 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.046 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:43:30.046 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:30.047 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.048 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:30.048 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:43:30.049 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:30.049 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:30.053 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.053 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:43:30.055 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:30.056 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:43:30.058 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.059 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:43:30.064 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:30.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:43:30.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.072 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:43:30.073 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:43:30.073 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:30.074 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:43:30.076 INFO 9 --- [ocp-schedules-6,fb8d1bb92616a49a,ba6ff531edbeb42d] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:43:30.077 INFO 9 --- [ocp-schedules-6,fb8d1bb92616a49a,ba6ff531edbeb42d] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:43:30.078 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:43:30.079 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:43:30.081 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:43:30.082 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:43:30.083 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:43:30.084 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:43:30.085 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:43:30.087 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:43:30.088 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.088 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:30.088 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.089 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:43:30.089 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:43:30.089 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:43:30.090 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:43:30.090 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:43:30.091 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.093 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:43:30.094 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:30.097 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.097 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:43:30.098 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.098 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:30.099 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:43:30.099 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:30.100 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get deadlock of zhengqi 2025-09-16 13:43:30.101 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:30.101 INFO 9 --- [prometheus-second-schedule-1,5b037362aa12ce3a,92003293dc18e27e] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:43:30.101 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:30.102 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:43:30.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:30.116 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:43:30.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:30.121 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.121 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:43:30.122 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:43:30, 2025-09-16 13:43:30] 2025-09-16 13:43:30.126 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:43:30.126 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.127 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:43:30.128 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:43:30.129 INFO 9 --- [host-check-host-status5,bbe032db85dc2fad,ef7d4586dfe45fed] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:43:30.130 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:43:30.130 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:43:30.133 INFO 9 --- [host-check-host-status2,bbe032db85dc2fad,f7086fa92fb7db84] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:43:30.133 INFO 9 --- [host-check-host-status3,bbe032db85dc2fad,796711fdc32dcc5b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:43:30.134 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:43:30.136 INFO 9 --- [host-check-host-status4,bbe032db85dc2fad,bc2120cf88964221] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:43:30.137 INFO 9 --- [host-check-host-status6,bbe032db85dc2fad,eb2f6829888a8c7e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:43:30.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:30.140 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:43:30.005670+08:00 2025-09-16 13:43:30.140 INFO 9 --- [host-check-host-status1,bbe032db85dc2fad,007d1a2d0ef343f5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:43:30.142 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:43:30.143 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.145 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:43:30, 2025-09-16 13:43:30] 2025-09-16 13:43:30.146 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:43:30.147 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.148 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:43:30.149 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.150 INFO 9 --- [ForkJoinPool-10-worker-11,ce057096708bf0aa,eb57af72ba882ecf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:43:30.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:30.154 INFO 9 --- [pool-12-thread-8,ce057096708bf0aa,24496ab0203c3a1d] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2025-09-16 13:43:30.164 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:43:30.166 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.167 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:43:30, 2025-09-16 13:43:30] 2025-09-16 13:43:30.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:30.170 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.p.o.i.OasSessionStatServiceImpl : finish fetching tenant session data of zhengqi 2025-09-16 13:43:30.170 INFO 9 --- [ForkJoinPool-10-worker-4,ce057096708bf0aa,632e3c84a2ce57c2] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching tenant session stat of zhengqi 2025-09-16 13:43:30.170 INFO 9 --- [pool-12-thread-7,ce057096708bf0aa,55038cb5b5ca4552] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2025-09-16 13:43:30.175 INFO 9 --- [ocp-async-4,c454ab34f66c35cb,14f062a7198ec515] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:43:30.182 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.182 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:30.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:43:30.211 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.211 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:43:30.226 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:43:30.240 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:30.241 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.242 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:43:30.247 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:43:30.250 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:43:30.253 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:30.254 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:30.257 INFO 9 --- [ocp-schedules-14,a8c930bcace0165f,ca4dd6f7ed043b46] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:43:30.257 INFO 9 --- [ocp-schedules-14,a8c930bcace0165f,ca4dd6f7ed043b46] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:30.258 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:43:30.258 INFO 9 --- [ocp-schedules-14,a8c930bcace0165f,ca4dd6f7ed043b46] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:43:30.267 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:43:30.328 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:43:30.342 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:30.343 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:30.344 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:43:30.359 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:30.359 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:43:30.359 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:43:30.359 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:30.359 INFO 9 --- [ocp-schedules-16,dc67b9c555004baa,46f1412293a8cdbc] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:43:30.380 INFO 9 --- [ocp-schedules-1,aeec6cce9f3af9ba,0dbb4734225afd08] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:43:30.555 INFO 9 --- [ocp-schedules-11,32528c2516098751,4229b1c8674d5303] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:43:30.557 INFO 9 --- [ocp-schedules-11,32528c2516098751,4229b1c8674d5303] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:43:30.557 INFO 9 --- [ocp-schedules-11,32528c2516098751,4229b1c8674d5303] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:43:30.752 WARN 9 --- [ocp-async-8,ecac27a9780128b1,69cb6a10d8dc99fd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:30.752 INFO 9 --- [ocp-async-6,35d37a0a9edab8a7,def22ecf354fd12e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:30.801 INFO 9 --- [ocp-schedules-10,f29549e1428026d2,b25797891ff11fd2] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:43:30.888 INFO 9 --- [host-check-clockdiff1,33b80fbd2f693444,a24eeedc2a1646e7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001410 -1 -1 , error= 2025-09-16 13:43:30.889 INFO 9 --- [host-check-clockdiff2,33b80fbd2f693444,70bd58710181df9b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001410 -1 -1 , error= 2025-09-16 13:43:30.940 INFO 9 --- [ocp-schedules-6,13982da09e0e8fe9,2711c479b74dee81] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:43:30.940 INFO 9 --- [ocp-schedules-6,13982da09e0e8fe9,2711c479b74dee81] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:43:31.401 INFO 9 --- [ocp-schedules-13,ba358f848b1c373b,b0e0ac1bfe4ff7fc] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:43:31.401 INFO 9 --- [ocp-schedules-13,ba358f848b1c373b,b0e0ac1bfe4ff7fc] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001411 2025-09-16 13:43:31.401 INFO 9 --- [ocp-schedules-13,ba358f848b1c373b,b0e0ac1bfe4ff7fc] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:43:31.574 INFO 9 --- [ocp-schedules-17,6b3a0f85c73be62e,a2aac80014763c14] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:43:31.625 INFO 9 --- [ocp-schedules-14,685d43e53521a776,bb7342a01cfa8d36] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:43:31.636 INFO 9 --- [prometheus-minute-schedule-1,9502efd1e86ff388,9473ed13e4c59f52] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:31.639 INFO 9 --- [prometheus-minute-schedule-1,9502efd1e86ff388,9473ed13e4c59f52] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:31.657 INFO 9 --- [ocp-schedules-16,31dc96a5a56aa529,6bd5e769fafbe9d9] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:43:31.657 INFO 9 --- [ocp-schedules-16,31dc96a5a56aa529,6bd5e769fafbe9d9] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:43:31.657 INFO 9 --- [ocp-schedules-16,31dc96a5a56aa529,6bd5e769fafbe9d9] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:43:31.657 INFO 9 --- [ocp-schedules-16,31dc96a5a56aa529,6bd5e769fafbe9d9] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:43:31.658 INFO 9 --- [ocp-schedules-16,31dc96a5a56aa529,6bd5e769fafbe9d9] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:43:31.658 INFO 9 --- [ocp-schedules-16,31dc96a5a56aa529,6bd5e769fafbe9d9] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:43:32.743 INFO 9 --- [ocp-schedules-4,9d746e29e71abf40,a5795000fc4e17b5] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2025-09-16 13:43:32.743 INFO 9 --- [ocp-schedules-4,9d746e29e71abf40,a5795000fc4e17b5] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2025-09-16 13:43:32.752 WARN 9 --- [ocp-async-4,bccd599592fbe398,9a7970d0bc28c1bb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:32.752 INFO 9 --- [ocp-async-9,9e50e7d7ac3ec1e5,e55cc25549a1a72d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:32.759 INFO 9 --- [pool-68-thread-1,9d746e29e71abf40,0e22ada3a59e75b4] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect mini compaction info 2025-09-16 13:43:32.782 INFO 9 --- [pool-68-thread-1,9d746e29e71abf40,0e22ada3a59e75b4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:32.784 INFO 9 --- [pool-68-thread-1,9d746e29e71abf40,0e22ada3a59e75b4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, MIN(unix_timestamp(`start_time`)*1000000) AS min_start_time, MAX(unix_timestamp(`finish_time`)*1000000) AS max_finish_time, SUM(occupy_size) AS occupy_size, SUM(total_row_count) AS total_row_count, COUNT(1) AS tablet_count FROM GV$OB_TABLET_COMPACTION_HISTORY WHERE type = 'MINI_MERGE' AND unix_timestamp(`finish_time`)*1000000 > ? AND unix_timestamp(`finish_time`)*1000000 <= ? GROUP BY tenant_id;, args: [1758001112000000, 1758001412000000] 2025-09-16 13:43:32.805 INFO 9 --- [pool-68-thread-1,9d746e29e71abf40,0e22ada3a59e75b4] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect mini compaction info 2025-09-16 13:43:32.805 INFO 9 --- [ocp-schedules-4,9d746e29e71abf40,a5795000fc4e17b5] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2025-09-16 13:43:33.261 INFO 9 --- [ocp-schedules-26,b472283a59168ef7,6a491f3d78dce61a] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:43:33.359 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:33.360 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:33.375 INFO 9 --- [ocp-schedules-15,c32c9f1a714cac05,277c3961bf271aaa] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:43:33.375+08:00, clusters=[1] 2025-09-16 13:43:33.382 INFO 9 --- [ocp-schedules-15,c32c9f1a714cac05,277c3961bf271aaa] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:43:33.935 INFO 9 --- [ocp-schedules-24,57c7b29e7409805d,90dca0a2e2c585e7] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:43:33.935 INFO 9 --- [ocp-schedules-24,57c7b29e7409805d,90dca0a2e2c585e7] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:43:33.935 INFO 9 --- [ocp-schedules-24,57c7b29e7409805d,90dca0a2e2c585e7] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:43:33.951 INFO 9 --- [ocp-schedules-24,57c7b29e7409805d,90dca0a2e2c585e7] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:43:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:43:34.428 INFO 9 --- [ocp-schedules-4,fa3b4d50106ec535,b378545effb03578] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:43:34.433 INFO 9 --- [ocp-schedules-4,fa3b4d50106ec535,b378545effb03578] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:43:34.433 INFO 9 --- [ocp-schedules-4,fa3b4d50106ec535,b378545effb03578] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:43:34.446 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2025-09-16 13:43:34.457 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:34.457 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:34.471 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:34.472 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:34.485 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:34.485 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:34.498 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:34.499 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:43:34.512 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:34.512 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:34.525 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:34.526 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:34.539 INFO 9 --- [ocp-schedules-14,19564e35c9d95fbd,20434588934896a8] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper finished, credentialSize=6, cachedSize=6 2025-09-16 13:43:34.542 INFO 9 --- [ocp-schedules-23,16b46d92c4994dff,6d5e81591e932dc0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:43:34.636 INFO 9 --- [prometheus-minute-schedule-1,a5605b2d3a18c1af,f516ea91c3abd49f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:34.639 INFO 9 --- [prometheus-minute-schedule-1,a5605b2d3a18c1af,f516ea91c3abd49f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:34.752 WARN 9 --- [ocp-async-9,686b2aadc0536675,db22b7b9015d5590] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:34.752 INFO 9 --- [ocp-async-7,79a6596d8417250e,6a3492d148a23a1a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:35.371 INFO 9 --- [ocp-schedules-29,63af8de32ef7ea51,acdd50593930035d] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:43:35.371+08:00, clusters=[1] 2025-09-16 13:43:35.404 INFO 9 --- [ocp-schedules-29,63af8de32ef7ea51,acdd50593930035d] c.o.o.p.s.i.alarm.SlowSqlDataSource : collect SlowSqlData for zhengqi, save 1 to SqlAggregateData 2025-09-16 13:43:36.360 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:36.361 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:36.752 WARN 9 --- [ocp-async-8,bf32d1c6879731bb,85fce77a69c26fac] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:36.752 INFO 9 --- [ocp-async-5,50ebbf79986c457b,fbd1646d16722c8c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:37.414 INFO 9 --- [ocp-schedules-16,440db79374031f35,8432cece114256cf] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:43:37.415 INFO 9 --- [ocp-schedules-16,440db79374031f35,8432cece114256cf] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:37.435 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:37.436 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:43:37.449 INFO 9 --- [ocp-schedules-16,440db79374031f35,8432cece114256cf] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:43:37.636 INFO 9 --- [prometheus-minute-schedule-1,084a6b05dc99f7ca,7056c0606a0f728b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:37.640 INFO 9 --- [prometheus-minute-schedule-1,084a6b05dc99f7ca,7056c0606a0f728b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:38.629 INFO 9 --- [ocp-schedules-3,48550163a07d01d3,3b3fb4b24fde98ad] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:43:38.631 INFO 9 --- [ocp-schedules-3,48550163a07d01d3,3b3fb4b24fde98ad] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:43:38.752 WARN 9 --- [ocp-async-4,565bc2ed03401eb4,521891c1d5e0e235] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:38.752 INFO 9 --- [ocp-async-10,b053b8447d6987c5,0f7af08437c50918] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:39.119 INFO 9 --- [ocp-schedules-1,a288183db2fe5773,7b31b4971936832e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:43:39.124 WARN 9 --- [scanner-1357186-1,a288183db2fe5773,ffc020085702e603] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:43:39.135 INFO 9 --- [alarm-detect-19,a288183db2fe5773,a8f051b5887ae1a9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 34, data is empty. 2025-09-16 13:43:39.136 INFO 9 --- [alarm-detect-2,a288183db2fe5773,a5d78ab6150a9a8a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 34, data is empty. 2025-09-16 13:43:39.136 INFO 9 --- [alarm-detect-4,a288183db2fe5773,9a021120f63e7968] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 34, data is empty. 2025-09-16 13:43:39.148 INFO 9 --- [alarm-detect-6,a288183db2fe5773,fd836ed7fcf76612] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 34, data is empty. 2025-09-16 13:43:39.361 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:39.361 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:39.375 INFO 9 --- [ocp-schedules-27,6bfd37ec0f1e267b,852947bdd38eadcc] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:43:39.375 INFO 9 --- [ocp-schedules-27,6bfd37ec0f1e267b,852947bdd38eadcc] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:43:39.383 INFO 9 --- [ocp-schedules-14,6b30b8a74363d1eb,f61dbb23c1ae94a2] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:43:39.383 INFO 9 --- [ocp-schedules-14,6b30b8a74363d1eb,f61dbb23c1ae94a2] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:43:39.383 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:43:39.383 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:43:39.383 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:43:39.383 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:43:39.387 INFO 9 --- [ocp-schedules-14,6b30b8a74363d1eb,f61dbb23c1ae94a2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:39.387 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:39.387 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:39.387 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:39.387 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:39.387 INFO 9 --- [ocp-schedules-14,6b30b8a74363d1eb,f61dbb23c1ae94a2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:43:39.388 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:39.388 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:39.388 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:39.388 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:39.391 INFO 9 --- [Collect all tenants major compactions1,6bfd37ec0f1e267b,7278bc02ef81b78f] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:43:39.391 INFO 9 --- [Collect all tenants major compactions2,6bfd37ec0f1e267b,6854b16560be69c5] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:43:39.391 INFO 9 --- [Collect all tenants major compactions3,6bfd37ec0f1e267b,fb19fa748a9969dd] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:43:39.401 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:43:39.402 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:43:39.402 INFO 9 --- [ocp-schedules-14,6b30b8a74363d1eb,f61dbb23c1ae94a2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:43:39.403 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:43:39.403 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:43:39.404 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:43:39.407 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:39.408 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:39.410 INFO 9 --- [Collect all tenants major compactions2,6bfd37ec0f1e267b,6854b16560be69c5] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:39.410 INFO 9 --- [Collect all tenants major compactions1,6bfd37ec0f1e267b,7278bc02ef81b78f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:39.410 INFO 9 --- [Collect all tenants major compactions3,6bfd37ec0f1e267b,fb19fa748a9969dd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:39.411 INFO 9 --- [Collect all tenants major compactions2,6bfd37ec0f1e267b,6854b16560be69c5] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:43:39.411 INFO 9 --- [Collect all tenants major compactions1,6bfd37ec0f1e267b,7278bc02ef81b78f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:43:39.412 INFO 9 --- [Collect all tenants major compactions3,6bfd37ec0f1e267b,fb19fa748a9969dd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:43:39.415 INFO 9 --- [Collect all tenants major compactions1,6bfd37ec0f1e267b,7278bc02ef81b78f] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:43:39.416 INFO 9 --- [Collect all tenants major compactions2,6bfd37ec0f1e267b,6854b16560be69c5] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:43:39.416 INFO 9 --- [Collect all tenants major compactions3,6bfd37ec0f1e267b,fb19fa748a9969dd] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:43:39.417 INFO 9 --- [ocp-schedules-27,6bfd37ec0f1e267b,852947bdd38eadcc] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:43:39.421 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:43:39.423 INFO 9 --- [ocp-schedules-14,6b30b8a74363d1eb,f61dbb23c1ae94a2] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:43:40.001 INFO 9 --- [ocp-schedules-11,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:43:40.002 INFO 9 --- [ocp-schedules-6,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:43:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:43:40.003974+08:00, lastProcessTime=2025-09-16T13:43:30.005670+08:00 2025-09-16 13:43:40.119 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:43:40.003974+08:00 2025-09-16 13:43:40.175 INFO 9 --- [ocp-async-1,6a31d87d0c0f3e18,44a99c99d8a91379] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:43:40.351 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:39:39.98, end=2025-09-16T13:41:40.35} 2025-09-16 13:43:40.355 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbit 2025-09-16 13:43:40.355 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:43:40.361 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 2 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:39:39.98, end=2025-09-16T13:41:40.35},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:43:40.367 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:43:40.367 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:43:40.376 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:43:40.378 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:39:39.98, end=2025-09-16T13:41:40.35},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:43:40.378 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:43:40.378 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:43:40.382 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:43:40.384 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:39:39.98, end=2025-09-16T13:41:40.35},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:43:40.384 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:43:40.384 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:43:40.388 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:43:40.636 INFO 9 --- [prometheus-minute-schedule-1,9648e5e23467cd0d,c8fdabe6bb0a183d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:40.639 INFO 9 --- [prometheus-minute-schedule-1,9648e5e23467cd0d,c8fdabe6bb0a183d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:40.752 WARN 9 --- [ocp-async-2,4d9d70889959b52d,ad7d76a125d35a4a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:40.753 INFO 9 --- [ocp-async-8,481e1750d28be033,2b2057ea85eba053] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:40.800 INFO 9 --- [ocp-schedules-23,6735e4752510a183,d2afe354979da9cb] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:43:40.801 INFO 9 --- [ocp-schedules-23,6735e4752510a183,d2afe354979da9cb] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:40.848 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:43:40.849 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.851 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:43:40.878 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.879 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:43:40.901 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.902 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:43:40.925 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.925 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:43:40.930 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.930 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:43:40.951 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.951 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:43:40.974 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.975 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:43:40.977 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:40.978 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:43:41.001 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.002 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:43:41.025 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.026 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:43:41.043 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.044 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:43:41.045 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.045 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:43:41.046 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.047 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:43:41.048 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.048 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:43:41.049 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.050 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:43:41.050 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.051 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:43:41.067 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.068 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:43:41.068 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.069 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:43:41.070 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.070 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:43:41.088 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:43:41.089 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:43:41.115 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:43:41.116 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.117 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:43:41.148 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:43:41.148 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:43:41.148 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:43:41.148 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:43:41.148 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:43:41.148 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:43:41.150 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:43:41.150 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:43:41.150 INFO 9 --- [ocp-schedules-23,6735e4752510a183,d2afe354979da9cb] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:43:41.729 INFO 9 --- [ocp-schedules-24,4e7a33e20af6e5de,3e787847ba6053a0] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:43:41.729 INFO 9 --- [ocp-schedules-24,4e7a33e20af6e5de,3e787847ba6053a0] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:43:41.766 INFO 9 --- [ocp-schedules-24,4e7a33e20af6e5de,3e787847ba6053a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:41.767 INFO 9 --- [ocp-schedules-24,4e7a33e20af6e5de,3e787847ba6053a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 13:43:41,862 |-INFO in ReconfigureOnChangeTask(born:1758001241862) - Empty watch file list. Disabling 2025-09-16 13:43:42.221 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 13:43:42.221 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 13:43:42.224 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:43:42.224 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:43:42.224 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:43:42.224 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:43:42.227 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:43:42.227 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:43:42.227 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:43:42.227 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:43:42.244 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:43:42.249 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:43:42.249 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:43:42.249 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:43:42.249 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:43:42.249 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:43:42.253 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:43:42.361 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:42.362 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:42.515 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 13:43:42.753 WARN 9 --- [ocp-async-4,b8ce5ecb29578e73,c977e0e775f67356] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:42.753 INFO 9 --- [ocp-async-1,af9443bc31765e59,76d108c6dc0b379b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:42.786 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.559844756S 2025-09-16 13:43:42.786 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:43:42.841 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 13:43:42.841 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 13:43:42.870 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 13:43:42,883 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:43:42,884 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:43:42,884 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:43:42,885 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:43:42,885 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:43:42,885 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:43:42,883 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:43:42,884 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:43:42,884 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:43:42,885 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:43:42,885 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:43:42,885 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:43:42,886 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@3ab0c5d6 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 13:43:42,888 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 13:43:42,888 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 13:43:42,890 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 13:43:42,890 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@3ab0c5d6 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 13:43:42,891 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 13:43:42,891 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 13:43:42,891 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 13:43:42,891 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 13:43:42,891 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 13:43:42,892 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 13:43:42,892 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:43:42,892 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 13:43:42,892 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@492128203 - setting totalSizeCap to 10 GB 13:43:42,893 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@492128203 - Archive files will be limited to [100 MB] each. 13:43:42,893 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@492128203 - Will use gz compression 13:43:42,893 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@492128203 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 13:43:42,893 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@21f7afc2 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 13:43:42,893 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@21f7afc2 - Roll-over at midnight. 13:43:42,893 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@21f7afc2 - Setting initial period to Tue Sep 16 13:43:42 CST 2025 13:43:42,893 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@492128203 - Cleaning on start up 13:43:42,893 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 13:43:42,893 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 13:43:42,894 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 13:43:42,894 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 13:43:42,894 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 13:43:42,894 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 13:43:42,894 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1139801745 - setting totalSizeCap to 10 GB 13:43:42,894 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1139801745 - Archive files will be limited to [100 MB] each. 13:43:42,894 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1139801745 - Will use gz compression 13:43:42,894 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1139801745 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 13:43:42,894 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@74339238 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 13:43:42,894 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@74339238 - Roll-over at midnight. 13:43:42,894 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@74339238 - Setting initial period to Tue Sep 16 13:43:29 CST 2025 13:43:42,894 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 13:43:42,894 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 13:43:42,894 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 13:43:42,894 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 13:43:42,894 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 13:43:42,894 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 13:43:42,894 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 13:43:42,895 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 13:43:42,895 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 13:43:42,895 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 13:43:42,895 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating INFO level on Logger[ROOT] onto the JUL framework 13:43:42,895 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 13:43:42,895 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 13:43:42,895 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 13:43:42,895 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:43:42,895 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@6826aac3 - Registering current configuration as safe fallback point 13:43:42,896 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 13:43:42,898 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating INFO level on Logger[web] onto the JUL framework 13:43:42,899 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 13:43:42,899 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@a08522b - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 13:43:42.900 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:43:42.900 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:43:42.900 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:43:42.900 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:43:42.900 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:43:42.900 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 13:43:42.906 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:43:42.993 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] o.s.boot.SpringApplication : Started application in 0.768 seconds (JVM running for 12398.037) 2025-09-16 13:43:42.993 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.769054803S 2025-09-16 13:43:43.241 INFO 9 --- [ocp-schedules-5,aad4455b1930cb48,f8c41b256494b1d0] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 13:43:43.636 INFO 9 --- [prometheus-minute-schedule-1,90ab9b4312de108b,334f81e44c76a7fa] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:43.640 INFO 9 --- [prometheus-minute-schedule-1,90ab9b4312de108b,334f81e44c76a7fa] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:44.545 INFO 9 --- [ocp-schedules-17,9349ea4ded543eb6,aba620f62dfbca15] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:43:44.753 WARN 9 --- [ocp-async-6,338956b09f2c094d,90a138f5b366fd5d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:44.753 INFO 9 --- [ocp-async-10,d6e9988d7c300eda,5f78ad90955f6739] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:45.362 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:45.363 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:46.636 INFO 9 --- [prometheus-minute-schedule-1,aada9db605a5b4c7,fa1f03be35ca8ab7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:46.639 INFO 9 --- [prometheus-minute-schedule-1,aada9db605a5b4c7,fa1f03be35ca8ab7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:46.753 INFO 9 --- [ocp-async-9,989bc907d70fa32d,d11699b44a33321c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:46.753 WARN 9 --- [ocp-async-3,27cf80e04a1a9ee7,9d1fe442663b8bc0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:48.363 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:48.363 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:48.635 INFO 9 --- [ocp-schedules-15,2c41466fc16b12c7,54458dd37f496927] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:43:48.638 INFO 9 --- [ocp-schedules-15,2c41466fc16b12c7,54458dd37f496927] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:43:48.753 INFO 9 --- [ocp-async-8,6ea3ed2b77c8afed,5f310c156be2bea4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:48.753 WARN 9 --- [ocp-async-7,a94d8501c624d35e,38a1e435e320699b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:49.151 INFO 9 --- [ocp-schedules-20,7caa9d6b3a44f819,f62b2c665e8cc80b] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:43:49.155 WARN 9 --- [scanner-1357346-1,7caa9d6b3a44f819,b0b4bef91d5dfae9] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:43:49.636 INFO 9 --- [prometheus-minute-schedule-1,ea630df2f7c4fe3d,6aa0e1acecd8a86b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:49.639 INFO 9 --- [prometheus-minute-schedule-1,ea630df2f7c4fe3d,6aa0e1acecd8a86b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:43:50.003945+08:00, lastProcessTime=2025-09-16T13:43:40.003974+08:00 2025-09-16 13:43:50.119 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:43:50.003945+08:00 2025-09-16 13:43:50.175 INFO 9 --- [ocp-async-3,d98e92a0c0636cf3,81a66a578905f22f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:43:50.754 INFO 9 --- [ocp-async-6,ad228a62d44f0b25,e53b8a87a81c0dbf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:50.754 WARN 9 --- [ocp-async-10,78c0896d3c7885c1,08f302a91a688516] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:51.363 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:51.364 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:52.636 INFO 9 --- [prometheus-minute-schedule-1,ecdee84fdaf3d020,119449bf83642a2a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:52.639 INFO 9 --- [prometheus-minute-schedule-1,ecdee84fdaf3d020,119449bf83642a2a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:52.754 INFO 9 --- [ocp-async-2,72cb8beab260b07b,e7a4b298a9321669] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:52.754 WARN 9 --- [ocp-async-9,a337f9e6e38f0aa4,19d6154e5bbc88c5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:54.364 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:54.365 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:54.434 INFO 9 --- [ocp-schedules-17,96a5a876759289dc,3e2fb8e9fe583ac9] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:43:54.439 INFO 9 --- [ocp-schedules-17,96a5a876759289dc,3e2fb8e9fe583ac9] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:43:54.439 INFO 9 --- [ocp-schedules-17,96a5a876759289dc,3e2fb8e9fe583ac9] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:43:54.549 INFO 9 --- [ocp-schedules-9,45a15e53a920f0f9,3e85aa9977afe19f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:43:54.754 INFO 9 --- [ocp-async-7,5d08fdbecf9aab09,9d1766ed89fa054b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:54.754 WARN 9 --- [ocp-async-8,b8102bd750e2d828,9800051c97b28b43] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:55.636 INFO 9 --- [prometheus-minute-schedule-1,3b63f8fd32e5217c,a4e7064f07848679] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:55.639 INFO 9 --- [prometheus-minute-schedule-1,3b63f8fd32e5217c,a4e7064f07848679] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:56.754 INFO 9 --- [ocp-async-1,71db37b44c9f64f5,9ba99215b25f6280] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:56.754 WARN 9 --- [ocp-async-5,322151342077424a,df7b142317a94382] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:57.365 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:43:57.365 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:43:58.636 INFO 9 --- [prometheus-minute-schedule-1,428d02e8d156a281,5cbe245f2626802c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001440, interval=60 2025-09-16 13:43:58.639 INFO 9 --- [prometheus-minute-schedule-1,428d02e8d156a281,5cbe245f2626802c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:43:58.642 INFO 9 --- [ocp-schedules-30,45e6126b15c6e7b7,12faf17928af42dd] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:43:58.644 INFO 9 --- [ocp-schedules-30,45e6126b15c6e7b7,12faf17928af42dd] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:43:58.754 WARN 9 --- [ocp-async-3,484748a727193f4a,dbe5ad7e8a972657] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:43:58.754 INFO 9 --- [ocp-async-9,8c82c16b371e1757,467978b0763c96ec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:43:59.178 INFO 9 --- [ocp-schedules-4,5db4588e5ea37692,2fdc47577c828911] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:43:59.184 WARN 9 --- [scanner-1357482-1,5db4588e5ea37692,50c122ff9894e120] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:43:59.194 INFO 9 --- [alarm-detect-6,5db4588e5ea37692,3a3d470e8a844425] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:43:59.197 INFO 9 --- [alarm-detect-14,5db4588e5ea37692,61e04eec8d1958b9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:43:59.197 INFO 9 --- [alarm-detect-1,5db4588e5ea37692,6e82a50ac1ea4f56] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:43:59.210 INFO 9 --- [alarm-detect-3,5db4588e5ea37692,33256432e9fba526] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:43:59.938 INFO 9 --- [ocp-schedules-25,45d0995cbe4f7783,25cf649f551e66c0] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:43:59.941 INFO 9 --- [ocp-schedules-2,07ffe1418d085bc7,d6430359a3a4556d] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:43:59.941 INFO 9 --- [ocp-schedules-15,8113c731984dbb0f,f3872e0a58976478] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:43:59.942 INFO 9 --- [ocp-schedules-8,f9c31b48adfe144d,7fa74e33f200623b] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:43:59.942 INFO 9 --- [ocp-schedules-2,07ffe1418d085bc7,d6430359a3a4556d] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:59.943 INFO 9 --- [ocp-schedules-15,8113c731984dbb0f,f3872e0a58976478] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:59.943 INFO 9 --- [ocp-schedules-8,f9c31b48adfe144d,7fa74e33f200623b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:43:59.944 INFO 9 --- [ocp-schedules-8,f9c31b48adfe144d,7fa74e33f200623b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:43:59.944 INFO 9 --- [ocp-schedules-16,3d4dd74cc69f89e5,70101d8c67add32a] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:43:59.944 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:43:59.944 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:43:59.944 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:43:59.944 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:43:59.944 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:43:59.944 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:43:59.945 INFO 9 --- [ocp-schedules-30,d468ef6ff2f089bf,fbd82926eb53dc7c] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:43:59.945 INFO 9 --- [ocp-schedules-7,e1f0aa4839bf5c20,6654e3450b2d83e8] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:43:59.945 INFO 9 --- [host-check-clockdiff1,d468ef6ff2f089bf,5aaf7bce8b21d806] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:43:59.945 INFO 9 --- [host-check-clockdiff2,d468ef6ff2f089bf,9bbf1c49fc1bf3fc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:43:59.945 INFO 9 --- [host-check-agent-status1,e1f0aa4839bf5c20,e3870a73aee7edff] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:43:59.945 INFO 9 --- [host-check-clockdiff3,d468ef6ff2f089bf,160da06630143f2c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:43:59.945 INFO 9 --- [host-check-agent-status2,e1f0aa4839bf5c20,48c78a335fcead2f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:43:59.945 INFO 9 --- [host-check-clockdiff4,d468ef6ff2f089bf,20ff79e6f75e8b69] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:43:59.945 INFO 9 --- [host-check-agent-status3,e1f0aa4839bf5c20,610ce2a7c6c5e307] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:43:59.946 INFO 9 --- [host-check-agent-status4,e1f0aa4839bf5c20,163a7df6cae1c574] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:43:59.946 INFO 9 --- [host-check-clockdiff5,d468ef6ff2f089bf,b906c70eb56a2298] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:43:59.946 INFO 9 --- [host-check-agent-status5,e1f0aa4839bf5c20,cc636b76e4c1499c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:43:59.946 INFO 9 --- [host-check-clockdiff6,d468ef6ff2f089bf,07cb11fe9b4420e8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:43:59.946 INFO 9 --- [host-check-agent-status6,e1f0aa4839bf5c20,77bebb1f59ebdccc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:43:59.948 INFO 9 --- [ocp-schedules-19,1f43613ff13c1963,ac6d30d41af6b150] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:43:59.950 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:59.951 INFO 9 --- [host-check-clockdiff6,d468ef6ff2f089bf,07cb11fe9b4420e8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001439 -1 -1 , error= 2025-09-16 13:43:59.951 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:59.951 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:59.951 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:59.951 INFO 9 --- [host-check-clockdiff3,d468ef6ff2f089bf,160da06630143f2c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001439 -1 -1 , error= 2025-09-16 13:43:59.951 INFO 9 --- [host-check-clockdiff2,d468ef6ff2f089bf,9bbf1c49fc1bf3fc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001439 -1 -1 , error= 2025-09-16 13:43:59.951 INFO 9 --- [host-check-clockdiff4,d468ef6ff2f089bf,20ff79e6f75e8b69] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001439 -1 -1 , error= 2025-09-16 13:43:59.951 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:59.951 INFO 9 --- [host-check-clockdiff5,d468ef6ff2f089bf,b906c70eb56a2298] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001439 -1 -1 , error= 2025-09-16 13:43:59.952 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:59.954 INFO 9 --- [host-check-agent-status1,e1f0aa4839bf5c20,e3870a73aee7edff] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:59.954 INFO 9 --- [host-check-agent-status6,e1f0aa4839bf5c20,77bebb1f59ebdccc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:59.954 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:59.954 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:59.954 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:59.954 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:59.954 INFO 9 --- [host-check-agent-status2,e1f0aa4839bf5c20,48c78a335fcead2f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:59.955 INFO 9 --- [host-check-agent-status3,e1f0aa4839bf5c20,610ce2a7c6c5e307] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:59.955 INFO 9 --- [host-check-agent-status4,e1f0aa4839bf5c20,163a7df6cae1c574] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:59.955 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:43:59.955 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:59.955 INFO 9 --- [host-check-agent-status6,e1f0aa4839bf5c20,77bebb1f59ebdccc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:59.955 INFO 9 --- [host-check-agent-status1,e1f0aa4839bf5c20,e3870a73aee7edff] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:59.955 INFO 9 --- [host-check-agent-status5,e1f0aa4839bf5c20,cc636b76e4c1499c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:59.955 INFO 9 --- [host-check-agent-status2,e1f0aa4839bf5c20,48c78a335fcead2f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:59.955 INFO 9 --- [host-check-agent-status3,e1f0aa4839bf5c20,610ce2a7c6c5e307] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:59.956 INFO 9 --- [host-check-agent-status4,e1f0aa4839bf5c20,163a7df6cae1c574] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:43:59.956 INFO 9 --- [host-check-agent-status5,e1f0aa4839bf5c20,cc636b76e4c1499c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:59.969 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:43:59.969 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:43:59.970 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:43:59.970 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:43:59.970 INFO 9 --- [host-check-agent-status2,e1f0aa4839bf5c20,48c78a335fcead2f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:43:59.970 INFO 9 --- [host-check-agent-status6,e1f0aa4839bf5c20,77bebb1f59ebdccc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:43:59.970 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:43:59.971 INFO 9 --- [host-check-agent-status1,e1f0aa4839bf5c20,e3870a73aee7edff] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:43:59.971 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:43:59.969857422+08:00 2025-09-16 13:43:59.971 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:59.971 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:43:59.971+08:00 2025-09-16 13:43:59.971 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:43:59.971 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:43:59.970868845+08:00 2025-09-16 13:43:59.971 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:43:59.970543082+08:00 2025-09-16 13:43:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:43:59.972 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:43:59.971+08:00 2025-09-16 13:43:59.972 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:43:59.971+08:00 2025-09-16 13:43:59.972 INFO 9 --- [host-check-agent-status5,e1f0aa4839bf5c20,cc636b76e4c1499c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:43:59.972 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:43:59.971478998+08:00 2025-09-16 13:43:59.972 INFO 9 --- [host-check-agent-status4,e1f0aa4839bf5c20,163a7df6cae1c574] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:43:59.972 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:43:59.972+08:00 2025-09-16 13:43:59.972 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:43:59.971402382+08:00 2025-09-16 13:43:59.973 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:43:59.972+08:00 2025-09-16 13:43:59.973 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:43:59.971772733+08:00 2025-09-16 13:43:59.973 INFO 9 --- [host-check-agent-status3,e1f0aa4839bf5c20,610ce2a7c6c5e307] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:43:59.973 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:43:59.973+08:00 2025-09-16 13:43:59.974 INFO 9 --- [host-check-agent-status2,e1f0aa4839bf5c20,48c78a335fcead2f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:43:59.974 INFO 9 --- [host-check-agent-status2,e1f0aa4839bf5c20,48c78a335fcead2f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:43:59.974 INFO 9 --- [host-check-agent-status2,e1f0aa4839bf5c20,48c78a335fcead2f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status1,e1f0aa4839bf5c20,e3870a73aee7edff] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status1,e1f0aa4839bf5c20,e3870a73aee7edff] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status1,e1f0aa4839bf5c20,e3870a73aee7edff] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status5,e1f0aa4839bf5c20,cc636b76e4c1499c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status5,e1f0aa4839bf5c20,cc636b76e4c1499c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status5,e1f0aa4839bf5c20,cc636b76e4c1499c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status4,e1f0aa4839bf5c20,163a7df6cae1c574] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status4,e1f0aa4839bf5c20,163a7df6cae1c574] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:43:59.975 INFO 9 --- [host-check-agent-status4,e1f0aa4839bf5c20,163a7df6cae1c574] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:43:59.976 INFO 9 --- [host-check-agent-status3,e1f0aa4839bf5c20,610ce2a7c6c5e307] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:43:59.976 INFO 9 --- [host-check-agent-status3,e1f0aa4839bf5c20,610ce2a7c6c5e307] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:43:59.976 INFO 9 --- [host-check-agent-status3,e1f0aa4839bf5c20,610ce2a7c6c5e307] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:43:59.976 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:43:59.977 INFO 9 --- [ocp-schedules-15,8113c731984dbb0f,f3872e0a58976478] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:43:59.977 INFO 9 --- [host-check-agent-status6,e1f0aa4839bf5c20,77bebb1f59ebdccc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:43:59.977 INFO 9 --- [host-check-agent-status6,e1f0aa4839bf5c20,77bebb1f59ebdccc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:43:59.977 INFO 9 --- [host-check-agent-status6,e1f0aa4839bf5c20,77bebb1f59ebdccc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:43:59.977 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:43:59.971+08:00 and status AVAILABLE 2025-09-16 13:43:59.979 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:43:59.971+08:00 and status AVAILABLE 2025-09-16 13:43:59.980 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:43:59.980 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:43:59.971+08:00 and status AVAILABLE 2025-09-16 13:43:59.981 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:43:59.973+08:00 and status AVAILABLE 2025-09-16 13:43:59.982 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:43:59.972+08:00 and status AVAILABLE 2025-09-16 13:43:59.982 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:43:59.982 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:43:59.983 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:43:59.983 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:43:59.972+08:00 and status AVAILABLE 2025-09-16 13:43:59.985 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:43:59.986 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:43:59.986 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:43:59.987 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:43:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:43:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:43:59.987 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:43:59.988 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:43:59.989 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:43:59.989 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:43:59.989 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:43:59.989 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:43:59.991 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:43:59.991 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:43:59.992 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:43:59.992 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:00.000 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:00.003 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:00.004 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:00.004 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:00.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:44:00.004908+08:00, lastProcessTime=2025-09-16T13:43:50.003945+08:00 2025-09-16 13:44:00.007 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:00.007 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:00.029 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:44:00.032 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:44:00.034 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:44:00.035 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:44:00.036 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:44:00.038 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:44:00.038 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:44:00.038 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:44:00.041 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:44:00.042 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:44:00.044 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:44:00.045 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:44:00.053 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:00.053 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:00.053 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:00.054 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:00.055 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:00.057 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:00.081 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:44:00.081 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:44:00.082 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:44:00.083 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:44:00.083 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:44:00.085 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:00.087 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:44:00.088 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:44:00.088 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:44:00.089 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:44:00.089 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:00.089 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:44:00.090 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:44:00.090 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:44:00.093 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:44:00.100 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:00.101 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:00.102 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:00.103 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:00.103 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:00.104 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:00.125 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:00.126 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:00.127 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:44:00.128 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:44:00.128 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:44:00.130 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:44:00.130 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:44:00.131 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:44:00.132 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:44:00.133 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:44:00.004908+08:00 2025-09-16 13:44:00.134 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:00.135 INFO 9 --- [host-check-host-status6,3d4dd74cc69f89e5,5ccb5d6e0c0542bb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:44:00.135 INFO 9 --- [host-check-host-status5,3d4dd74cc69f89e5,763aef35658b6126] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:44:00.136 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:44:00.137 INFO 9 --- [host-check-host-status1,3d4dd74cc69f89e5,2c546b954715dc65] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:44:00.137 INFO 9 --- [host-check-host-status2,3d4dd74cc69f89e5,9d00e2a540236b56] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:44:00.138 INFO 9 --- [host-check-host-status3,3d4dd74cc69f89e5,ed9a20b7bb68330b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:44:00.138 INFO 9 --- [host-check-host-status4,3d4dd74cc69f89e5,d6a4a1f5f64be1d4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:44:00.142 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:00.157 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.157 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:00.176 INFO 9 --- [ocp-async-5,00eaed20a2c3692b,65a2950668b7d5d4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:44:00.189 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.189 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:00.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:00.234 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.234 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:00.263 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.263 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:00.277 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.277 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:00.293 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:00.307 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:00.308 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:00.309 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:00.314 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:44:00.317 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:44:00.320 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:00.321 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:00.334 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:44:00.365 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:00.366 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:00.394 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:44:00.409 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:00.413 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:00.414 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:44:00.428 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:44:00.428 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:44:00.429 INFO 9 --- [ocp-schedules-2,07ffe1418d085bc7,d6430359a3a4556d] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:44:00.754 WARN 9 --- [ocp-async-7,e2b87bd0c78b09a8,452002d6d3071a4c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:00.754 INFO 9 --- [ocp-async-4,e3a11dc2f425b591,960ff9e5709c9137] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:00.803 INFO 9 --- [ocp-schedules-15,8d52cf14413293df,185c1fcd27739587] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:44:00.887 INFO 9 --- [host-check-clockdiff1,d468ef6ff2f089bf,5aaf7bce8b21d806] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001440 -1 -1 , error= 2025-09-16 13:44:01.636 INFO 9 --- [prometheus-minute-schedule-1,6c2e0942cc027cd5,0c608a34cd35b4dd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:01.639 INFO 9 --- [prometheus-minute-schedule-1,6c2e0942cc027cd5,0c608a34cd35b4dd] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:02.754 INFO 9 --- [ocp-async-10,819f7d3d5aa66bb6,a2ffd58d8918b057] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:02.754 WARN 9 --- [ocp-async-1,016d6aa177f6426e,7bba0f13f5d05343] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:03.366 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:03.366 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:04.552 INFO 9 --- [ocp-schedules-25,28b488592a296b65,667bbf4500454540] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:44:04.636 INFO 9 --- [prometheus-minute-schedule-1,b470f0e9948f11b3,fecfe2b6c399e07a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:04.639 INFO 9 --- [prometheus-minute-schedule-1,b470f0e9948f11b3,fecfe2b6c399e07a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:04.754 INFO 9 --- [ocp-async-6,e20a455b595c1712,9859a70143a0158b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:04.754 WARN 9 --- [ocp-async-9,f67abb77c72e44e8,deb54196ba642ddc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:06.367 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:06.367 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:06.755 INFO 9 --- [ocp-async-2,6746762829862ef6,686fed0bc987a975] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:06.755 WARN 9 --- [ocp-async-8,491e8783d78f5410,bcf20116e5e8869b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:07.636 INFO 9 --- [prometheus-minute-schedule-1,439a0ebcabc5e3df,aba9485314e8a554] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:07.639 INFO 9 --- [prometheus-minute-schedule-1,439a0ebcabc5e3df,aba9485314e8a554] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:08.648 INFO 9 --- [ocp-schedules-22,31d12713087ae09b,93cbb0986594c1c5] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:44:08.650 INFO 9 --- [ocp-schedules-22,31d12713087ae09b,93cbb0986594c1c5] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:44:08.755 INFO 9 --- [ocp-async-4,114af2c711c43f94,7f9d73a944e95440] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:08.755 WARN 9 --- [ocp-async-1,867b227cb9e52d28,7bf048df0782eff8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:09.213 INFO 9 --- [ocp-schedules-4,902f17197817b0bf,85d261afd157536a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:44:09.218 WARN 9 --- [scanner-1357651-1,902f17197817b0bf,477026ee3aa73314] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:44:09.367 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:09.368 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:09.438 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,8fbbe1e84080a200,ac6fbe58306a2eb9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=8fbbe1e84080a200, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:44:09.438 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,8fbbe1e84080a200,ac6fbe58306a2eb9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=8fbbe1e84080a200, duration=1 ms] 2025-09-16 13:44:10.003 INFO 9 --- [ocp-schedules-25,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:44:10.003 INFO 9 --- [ocp-schedules-6,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:44:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:44:10.003603+08:00, lastProcessTime=2025-09-16T13:44:00.004908+08:00 2025-09-16 13:44:10.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:44:10.003603+08:00 2025-09-16 13:44:10.176 INFO 9 --- [ocp-async-8,05712413aa3ea717,0851a4b254e68ebb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:44:10.298 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:44:10.636 INFO 9 --- [prometheus-minute-schedule-1,79269cd8d165cbe9,581d14889a07fe06] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:10.639 INFO 9 --- [prometheus-minute-schedule-1,79269cd8d165cbe9,581d14889a07fe06] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:10.755 INFO 9 --- [ocp-async-9,5868e658cb19e1e0,e795cdfc4eef7e5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:10.755 WARN 9 --- [ocp-async-3,ade15df31c39ffa1,a40ea7d97eef9c54] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:11.682 INFO 9 --- [metric-archive-async-3,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001380, nodeCount=460, affectRows=460 2025-09-16 13:44:12.368 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:12.368 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:12.735 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001380, nodeCount=1000, affectRows=1000 2025-09-16 13:44:12.738 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001380, nodeCount=1000, validCount=996 2025-09-16 13:44:12.755 INFO 9 --- [ocp-async-8,0178aa180997ce92,dbb9f6d7558303fa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:12.755 WARN 9 --- [ocp-async-7,25b9eeda886c7665,e4402c2dafb478c3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:12.762 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001380, nodeCount=1000, affectRows=1000 2025-09-16 13:44:12.765 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001380, nodeCount=1000, validCount=998 2025-09-16 13:44:12.775 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952599621632-1758001320' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952599621632-1758001320' for key 'PRIMARY' 2025-09-16 13:44:13.636 INFO 9 --- [prometheus-minute-schedule-1,a9f5e38f3adeb684,699a26b5fdaf535f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:13.639 INFO 9 --- [prometheus-minute-schedule-1,a9f5e38f3adeb684,699a26b5fdaf535f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:14.043 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001380, nodeCount=1000, affectRows=1000 2025-09-16 13:44:14.045 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001380, nodeCount=994, validCount=959 2025-09-16 13:44:14.056 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952427655168-1758001320' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952427655168-1758001320' for key 'PRIMARY' 2025-09-16 13:44:14.440 INFO 9 --- [ocp-schedules-30,b5d247029cc0ddc1,cf2630fc8be497ca] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:44:14.446 INFO 9 --- [ocp-schedules-30,b5d247029cc0ddc1,cf2630fc8be497ca] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:44:14.446 INFO 9 --- [ocp-schedules-30,b5d247029cc0ddc1,cf2630fc8be497ca] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:44:14.556 INFO 9 --- [ocp-schedules-29,78b0f53815190869,820d5f0162a276c4] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:44:14.755 INFO 9 --- [ocp-async-1,6e8293ca7cfdad82,f8c4f048ba700b58] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:14.755 WARN 9 --- [ocp-async-5,6a92b2ba88a8c327,677a6e8dcfb36613] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:15.196 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001380, nodeCount=853, affectRows=853 2025-09-16 13:44:15.199 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001380, nodeCount=852, validCount=839 2025-09-16 13:44:15.369 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:15.369 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:16.636 INFO 9 --- [prometheus-minute-schedule-1,60c4c5b520f651b8,aa18ef077ccdf479] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:16.639 INFO 9 --- [prometheus-minute-schedule-1,60c4c5b520f651b8,aa18ef077ccdf479] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:16.755 INFO 9 --- [ocp-async-10,53893feb9a1e475e,ed4f4b95f1e5ba02] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:16.755 WARN 9 --- [ocp-async-3,00e31b509da9edd8,0f7eb27bac4a1d97] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:18.369 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:18.370 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:18.654 INFO 9 --- [ocp-schedules-30,1fdd16aa83b98b82,293affb399a32c52] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:44:18.656 INFO 9 --- [ocp-schedules-30,1fdd16aa83b98b82,293affb399a32c52] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:44:18.755 INFO 9 --- [ocp-async-9,846caf6ba0c46329,0119a9b0f38976da] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:18.755 WARN 9 --- [ocp-async-7,b93cb3d1ba5e4c1a,0c6dcec9952b3593] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:19.239 INFO 9 --- [ocp-schedules-27,0f4d5165efb7361c,fceec8247966f1da] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:44:19.244 WARN 9 --- [scanner-1358647-1,0f4d5165efb7361c,c5f5025b24d624ca] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:44:19.254 INFO 9 --- [alarm-detect-11,0f4d5165efb7361c,9fa60ca339f85fe9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:44:19.256 INFO 9 --- [alarm-detect-1,0f4d5165efb7361c,4e912d4320caeeeb] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:44:19.256 INFO 9 --- [alarm-detect-7,0f4d5165efb7361c,78433ebc3e99d387] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:44:19.268 INFO 9 --- [alarm-detect-9,0f4d5165efb7361c,db83cdfa1b102091] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:44:19.636 INFO 9 --- [prometheus-minute-schedule-1,154aff11a3daf9ef,c5358dcb93557f43] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:19.639 INFO 9 --- [prometheus-minute-schedule-1,154aff11a3daf9ef,c5358dcb93557f43] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:44:20.003922+08:00, lastProcessTime=2025-09-16T13:44:10.003603+08:00 2025-09-16 13:44:20.116 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:44:20.003922+08:00 2025-09-16 13:44:20.176 INFO 9 --- [ocp-async-3,93fdcf8771ecff02,4eb1cd174c0805d2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:44:20.636 INFO 9 --- [prometheus-cache-monitor1,c564401a07c491ba,7e3fbd9a96781ea3] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:44:20.636 INFO 9 --- [prometheus-cache-monitor1,c564401a07c491ba,7e3fbd9a96781ea3] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:44:20.755 INFO 9 --- [ocp-async-5,7b97ee1e7611dfb8,de7e1fd8ec289e48] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:20.755 WARN 9 --- [ocp-async-4,c5819c1edb7bf0e0,aa2e406a6cf9603b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:21.370 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:21.370 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:22.636 INFO 9 --- [prometheus-minute-schedule-1,251a6731e0f77134,fc71b5ab3ca7266b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:22.639 INFO 9 --- [prometheus-minute-schedule-1,251a6731e0f77134,fc71b5ab3ca7266b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:22.755 INFO 9 --- [ocp-async-3,d383df7c063483af,fe7723792867df59] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:22.756 WARN 9 --- [ocp-async-6,9dc6e0d8fe70fa16,09921017780d3697] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:23.876 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.881 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitr 2025-09-16 13:44:23.892 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.903 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.913 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.924 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.927 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.930 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.933 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.936 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.940 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.943 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.946 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.949 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:23.766, end=2025-09-16T13:43:23.875} 2025-09-16 13:44:23.949 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2025-09-16 13:44:24.370 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:24.371 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:24.560 INFO 9 --- [ocp-schedules-18,431e37a5565497cf,e2196310998095ce] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:44:24.756 WARN 9 --- [ocp-async-7,fd77d0b689d0fd79,2fa42c597cd68590] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:24.756 INFO 9 --- [ocp-async-2,2df18c9132460e4e,2feec28c99f27ba3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:25.636 INFO 9 --- [prometheus-minute-schedule-1,c74415f0b3c1ca9c,dd88a247ff6e1f3d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:25.639 INFO 9 --- [prometheus-minute-schedule-1,c74415f0b3c1ca9c,dd88a247ff6e1f3d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:26.756 INFO 9 --- [ocp-async-8,7c160921dc85a68f,4440ad1f17a476e7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:26.756 WARN 9 --- [ocp-async-4,d0419574fdead5a2,6c7696068a3d248c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:27.371 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:27.372 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:27.680 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.683 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitra 2025-09-16 13:44:27.687 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.691 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 2 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.729 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.733 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 2 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.771 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.784 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.784 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION is disabled or lacking of config 2025-09-16 13:44:27.796 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.808 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 8 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.874 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.878 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.881 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 2 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.888 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.892 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 2 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.917 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:38:27.451, end=2025-09-16T13:43:27.678} 2025-09-16 13:44:27.917 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 7 dubious sqls 2025-09-16 13:44:28.636 INFO 9 --- [prometheus-minute-schedule-1,5a00a6430e49ac55,8ff03dd69ea4d0da] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:28.639 INFO 9 --- [prometheus-minute-schedule-1,5a00a6430e49ac55,8ff03dd69ea4d0da] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:28.661 INFO 9 --- [ocp-schedules-21,42aaf65a831df51b,330403c3ff7fbef9] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:44:28.663 INFO 9 --- [ocp-schedules-21,42aaf65a831df51b,330403c3ff7fbef9] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:44:28.756 WARN 9 --- [ocp-async-5,4da17a089ac6b00a,af529f18cd087c37] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:28.756 INFO 9 --- [ocp-async-6,7af5ec4b38412f88,411c6c974c736d85] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:29.271 INFO 9 --- [ocp-schedules-11,e52d6d9335dc7c6c,557aa0e957c6bd81] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:44:29.276 WARN 9 --- [scanner-1358805-1,e52d6d9335dc7c6c,901764354832caeb] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:44:29.938 INFO 9 --- [ocp-schedules-18,d601991a3301b491,00c61fe09b7ac3e6] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:44:29.941 INFO 9 --- [ocp-schedules-21,af0232ab34f363ee,9e15a0ebbb9a6b09] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:44:29.941 INFO 9 --- [ocp-schedules-25,d8d0c0fb43c9c342,9781907c9feb7a84] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:44:29.942 INFO 9 --- [ocp-schedules-14,6e0341557bda6625,f5d9df5d2ce2ba36] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:44:29.942 INFO 9 --- [ocp-schedules-21,af0232ab34f363ee,9e15a0ebbb9a6b09] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:29.943 INFO 9 --- [ocp-schedules-25,d8d0c0fb43c9c342,9781907c9feb7a84] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:29.943 INFO 9 --- [ocp-schedules-14,6e0341557bda6625,f5d9df5d2ce2ba36] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:29.944 INFO 9 --- [ocp-schedules-14,6e0341557bda6625,f5d9df5d2ce2ba36] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:44:29.944 INFO 9 --- [ocp-schedules-12,93b17e00061c8449,327e5da5227e8510] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:29.944 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:44:29.944 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:44:29.944 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:44:29.944 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:44:29.944 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:44:29.944 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:44:29.945 INFO 9 --- [ocp-schedules-18,cf56c593f8635daf,6601ff3e7fe50121] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:29.945 INFO 9 --- [host-check-clockdiff1,cf56c593f8635daf,09bd07818bc82711] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:44:29.945 INFO 9 --- [host-check-clockdiff2,cf56c593f8635daf,d3ee570d2545bfc5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:44:29.945 INFO 9 --- [host-check-clockdiff3,cf56c593f8635daf,d1f18442c2fa3b24] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:44:29.945 INFO 9 --- [host-check-clockdiff4,cf56c593f8635daf,dfd7863410396bb6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:44:29.945 INFO 9 --- [host-check-clockdiff5,cf56c593f8635daf,604eff49f3b684b7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:44:29.945 INFO 9 --- [host-check-clockdiff6,cf56c593f8635daf,b22045ff8984426a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:44:29.946 INFO 9 --- [ocp-schedules-24,7faa3f41240c823a,c1d1b1fb99697975] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:29.946 INFO 9 --- [host-check-agent-status1,7faa3f41240c823a,ea96488e24380c58] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:44:29.946 INFO 9 --- [host-check-agent-status2,7faa3f41240c823a,328631fa51ac8327] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:44:29.946 INFO 9 --- [host-check-agent-status3,7faa3f41240c823a,37e9cfe93b225657] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:44:29.946 INFO 9 --- [host-check-agent-status4,7faa3f41240c823a,f57f48266160d65b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:44:29.946 INFO 9 --- [host-check-agent-status5,7faa3f41240c823a,633f815696f05876] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:44:29.946 INFO 9 --- [host-check-agent-status6,7faa3f41240c823a,038f8d66b8bd8b20] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:44:29.949 INFO 9 --- [host-check-clockdiff1,cf56c593f8635daf,09bd07818bc82711] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001469 0 0 , error= 2025-09-16 13:44:29.950 INFO 9 --- [ocp-schedules-28,fac029c17de338df,2dfc3eca1df66085] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:44:29.953 INFO 9 --- [host-check-clockdiff6,cf56c593f8635daf,b22045ff8984426a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001469 -1 -1 , error= 2025-09-16 13:44:29.953 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:44:29.954 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:44:29.954 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:44:29.954 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:29.954 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:44:29.954 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:44:29.954 INFO 9 --- [host-check-clockdiff5,cf56c593f8635daf,604eff49f3b684b7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001469 -1 -1 , error= 2025-09-16 13:44:29.955 INFO 9 --- [host-check-agent-status1,7faa3f41240c823a,ea96488e24380c58] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:44:29.956 INFO 9 --- [host-check-agent-status4,7faa3f41240c823a,f57f48266160d65b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:44:29.956 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:44:29.956 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:29.956 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:44:29.956 INFO 9 --- [host-check-agent-status1,7faa3f41240c823a,ea96488e24380c58] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:44:29.956 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:44:29.956 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:44:29.956 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:29.956 INFO 9 --- [host-check-agent-status6,7faa3f41240c823a,038f8d66b8bd8b20] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:29.956 INFO 9 --- [host-check-agent-status5,7faa3f41240c823a,633f815696f05876] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:44:29.956 INFO 9 --- [host-check-agent-status2,7faa3f41240c823a,328631fa51ac8327] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:44:29.956 INFO 9 --- [host-check-agent-status3,7faa3f41240c823a,37e9cfe93b225657] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:44:29.957 INFO 9 --- [host-check-agent-status4,7faa3f41240c823a,f57f48266160d65b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:29.957 INFO 9 --- [host-check-agent-status6,7faa3f41240c823a,038f8d66b8bd8b20] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:29.957 INFO 9 --- [host-check-agent-status5,7faa3f41240c823a,633f815696f05876] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:44:29.957 INFO 9 --- [host-check-agent-status2,7faa3f41240c823a,328631fa51ac8327] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:44:29.957 INFO 9 --- [host-check-agent-status3,7faa3f41240c823a,37e9cfe93b225657] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:44:29.962 INFO 9 --- [ocp-schedules-23,f9fc2b7f8536c85e,82328aa339169844] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:44:29.963 INFO 9 --- [ocp-schedules-5,a480b812aec08cb9,64d8783a8d8ef02f] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:44:29.968 INFO 9 --- [ocp-schedules-23,f9fc2b7f8536c85e,82328aa339169844] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:44:29.970 INFO 9 --- [ocp-schedules-5,a480b812aec08cb9,64d8783a8d8ef02f] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:44:29.971 INFO 9 --- [host-check-agent-status4,7faa3f41240c823a,f57f48266160d65b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:44:29.971 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:44:29.971 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:44:29.971 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:44:29.972 INFO 9 --- [host-check-agent-status1,7faa3f41240c823a,ea96488e24380c58] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:44:29.972 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:44:29.972 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:44:29.972 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:44:29.973 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:44:29.971670143+08:00 2025-09-16 13:44:29.973 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:44:29.973+08:00 2025-09-16 13:44:29.973 INFO 9 --- [host-check-agent-status5,7faa3f41240c823a,633f815696f05876] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:44:29.973 INFO 9 --- [host-check-agent-status6,7faa3f41240c823a,038f8d66b8bd8b20] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:44:29.973 INFO 9 --- [host-check-agent-status3,7faa3f41240c823a,37e9cfe93b225657] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:44:29.973065479+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:44:29.972742992+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-agent-status2,7faa3f41240c823a,328631fa51ac8327] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:44:29.974+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:44:29.973562621+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:44:29.973240533+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:44:29.973162657+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:44:29.974+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:44:29.974+08:00 2025-09-16 13:44:29.974 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:44:29.974+08:00 2025-09-16 13:44:29.975 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:44:29.974+08:00 2025-09-16 13:44:29.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:29.975 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:44:29.973+08:00 and status AVAILABLE 2025-09-16 13:44:29.975 INFO 9 --- [host-check-agent-status4,7faa3f41240c823a,f57f48266160d65b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:44:29.975 INFO 9 --- [host-check-agent-status4,7faa3f41240c823a,f57f48266160d65b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:44:29.975 INFO 9 --- [host-check-agent-status4,7faa3f41240c823a,f57f48266160d65b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:44:29.976 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:44:29.974+08:00 and status AVAILABLE 2025-09-16 13:44:29.976 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:44:29.974+08:00 and status AVAILABLE 2025-09-16 13:44:29.976 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:44:29.974+08:00 and status AVAILABLE 2025-09-16 13:44:29.976 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:44:29.974+08:00 and status AVAILABLE 2025-09-16 13:44:29.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:29.976 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:44:29.974+08:00 and status AVAILABLE 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status2,7faa3f41240c823a,328631fa51ac8327] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status2,7faa3f41240c823a,328631fa51ac8327] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status2,7faa3f41240c823a,328631fa51ac8327] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status1,7faa3f41240c823a,ea96488e24380c58] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status1,7faa3f41240c823a,ea96488e24380c58] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status1,7faa3f41240c823a,ea96488e24380c58] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status3,7faa3f41240c823a,37e9cfe93b225657] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status3,7faa3f41240c823a,37e9cfe93b225657] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:44:29.977 INFO 9 --- [host-check-agent-status3,7faa3f41240c823a,37e9cfe93b225657] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:44:29.978 INFO 9 --- [host-check-agent-status6,7faa3f41240c823a,038f8d66b8bd8b20] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:44:29.978 INFO 9 --- [host-check-agent-status6,7faa3f41240c823a,038f8d66b8bd8b20] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:44:29.978 INFO 9 --- [host-check-agent-status6,7faa3f41240c823a,038f8d66b8bd8b20] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:44:29.979 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:44:29.979 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:44:29.979 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:44:29.980 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:44:29.980 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:44:29.980 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:44:29.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:44:29.981 INFO 9 --- [ocp-schedules-25,d8d0c0fb43c9c342,9781907c9feb7a84] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:44:29.984 INFO 9 --- [host-check-agent-status5,7faa3f41240c823a,633f815696f05876] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:44:29.984 INFO 9 --- [host-check-agent-status5,7faa3f41240c823a,633f815696f05876] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:44:29.984 INFO 9 --- [host-check-agent-status5,7faa3f41240c823a,633f815696f05876] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:44:29.985 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:44:29.985 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:44:29.985 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:44:29.985 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:29.986 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:44:29.986 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:44:29.986 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:44:29.986 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:29.986 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:29.986 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:44:29.987 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:44:29.987 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:44:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:44:30.000 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:30.000 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:30.000 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:30.000 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:30.002 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:30.002 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:30.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:44:30.003583+08:00, lastProcessTime=2025-09-16T13:44:20.003922+08:00 2025-09-16 13:44:30.028 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:44:30.028 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:44:30.029 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:44:30.029 INFO 9 --- [ocp-schedules-3,702a28ddf25463c7,61b0d55ff644469f] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:44:30.029 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:44:30.029 INFO 9 --- [ocp-schedules-3,702a28ddf25463c7,61b0d55ff644469f] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:44:30.030 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:44:30.033 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:44:30.035 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:44:30.035 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:44:30.035 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:44:30.035 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:44:30.036 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:44:30.040 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:44:30.047 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:30.047 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:30.047 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:30.047 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:30.049 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:30.051 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:44:30.055 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:30.056 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:30.057 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:44:30.074 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:44:30.075 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:44:30.076 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:44:30.076 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:44:30.077 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:44:30.079 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:44:30.081 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:44:30.082 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:44:30.082 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:44:30.082 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:44:30.084 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:44:30.086 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:44:30.092 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:30.093 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:30.094 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:30.094 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:30.094 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:30.094 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:30.095 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:44:30.095 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:30.098 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:44:30.101 INFO 9 --- [prometheus-second-schedule-1,2158790eb6d52c11,2bdc3af35c772d03] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:44:30.122 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:30.122 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:44:30.123 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:44:30.124 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:44:30.125 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:44:30.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:30.126 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:44:30.126 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:44:30.127 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:44:30.003583+08:00 2025-09-16 13:44:30.129 INFO 9 --- [host-check-host-status5,93b17e00061c8449,7cbacd4b091ec340] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:44:30.129 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:44:30.129 INFO 9 --- [host-check-host-status4,93b17e00061c8449,421f1f9b313e3771] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:44:30.132 INFO 9 --- [host-check-host-status2,93b17e00061c8449,0b83895858c96024] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:44:30.132 INFO 9 --- [host-check-host-status6,93b17e00061c8449,4a4cddeab56988c2] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:44:30.132 INFO 9 --- [host-check-host-status1,93b17e00061c8449,2c72e35c144f0f17] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:44:30.136 INFO 9 --- [host-check-host-status3,93b17e00061c8449,e5edea42ecf7046c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:44:30.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:30.156 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.156 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:30.169 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.169 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:30.176 INFO 9 --- [ocp-async-8,365a5f22a4b78266,56f93faa6d63d91b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:44:30.185 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.185 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:30.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:30.213 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.213 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:30.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:30.244 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.244 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:44:30.256 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.256 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:44:30.258 INFO 9 --- [ocp-schedules-22,a92acbd564e22c23,63a6160903383856] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:44:30.259 INFO 9 --- [ocp-schedules-22,a92acbd564e22c23,63a6160903383856] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:30.259 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:44:30.259 INFO 9 --- [ocp-schedules-22,a92acbd564e22c23,63a6160903383856] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:44:30.263 INFO 9 --- [ocp-schedules-13,c1e8dde7ca2717c9,a287e0355d6af0c7] c.o.o.s.common.scheduled.HostSchedules : Check host version schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:30.263 INFO 9 --- [ocp-schedules-13,c1e8dde7ca2717c9,a287e0355d6af0c7] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-version, skip execute 2025-09-16 13:44:30.271 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:44:30.284 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:30.286 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:30.287 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:30.292 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:44:30.295 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:44:30.297 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:30.298 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:30.311 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:44:30.372 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:30.372 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:30.373 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:44:30.382 INFO 9 --- [ocp-schedules-14,cf4deb78b9c25c10,69b2fac944db0de4] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:44:30.388 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:30.390 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:30.390 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:44:30.405 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:44:30.405 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:44:30.405 INFO 9 --- [ocp-schedules-21,af0232ab34f363ee,9e15a0ebbb9a6b09] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:44:30.557 INFO 9 --- [ocp-schedules-6,7954f05646ef425f,8eee1921530b481f] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:44:30.559 INFO 9 --- [ocp-schedules-6,7954f05646ef425f,8eee1921530b481f] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:44:30.559 INFO 9 --- [ocp-schedules-6,7954f05646ef425f,8eee1921530b481f] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:44:30.756 WARN 9 --- [ocp-async-9,0552dcc21bc0500d,e64715481e409916] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:30.756 INFO 9 --- [ocp-async-4,1f432d9194c50fde,10327cb4f57c877b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:30.805 INFO 9 --- [ocp-schedules-24,8016fa0afeca1f5b,ea1a67d7e8a4c5e7] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:44:30.889 INFO 9 --- [host-check-clockdiff4,cf56c593f8635daf,dfd7863410396bb6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001470 -1 -1 , error= 2025-09-16 13:44:30.889 INFO 9 --- [host-check-clockdiff2,cf56c593f8635daf,d3ee570d2545bfc5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001470 -2 -2 , error= 2025-09-16 13:44:30.890 INFO 9 --- [host-check-clockdiff3,cf56c593f8635daf,d1f18442c2fa3b24] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001470 -1 -1 , error= 2025-09-16 13:44:30.943 INFO 9 --- [ocp-schedules-12,418f1e13e15a7a5c,9aa34c29cdfe2ff7] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:44:30.943 INFO 9 --- [ocp-schedules-12,418f1e13e15a7a5c,9aa34c29cdfe2ff7] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:44:31.405 INFO 9 --- [ocp-schedules-10,8fcd8b5e5a25a691,e3b5e3b463cab487] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:44:31.405 INFO 9 --- [ocp-schedules-10,8fcd8b5e5a25a691,e3b5e3b463cab487] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001471 2025-09-16 13:44:31.408 INFO 9 --- [ocp-schedules-10,8fcd8b5e5a25a691,e3b5e3b463cab487] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:44:31.573 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2025-09-16 13:44:31.573 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2025-09-16 13:44:31.576 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2025-09-16 13:44:31.576 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: binlogQueryCache 2025-09-16 13:44:31.576 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.c.cache.helper.BinlogQueryCache : Init binlog cache. 2025-09-16 13:44:31.580 INFO 9 --- [ocp-schedules-15,34d267ea103c91f5,ea368eba20fe5808] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:44:31.581 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.c.cache.helper.BinlogQueryCache : Finish init binlog cache. 2025-09-16 13:44:31.581 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2025-09-16 13:44:31.581 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2025-09-16 13:44:31.589 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2025-09-16 13:44:31.589 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2025-09-16 13:44:31.589 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2025-09-16 13:44:31.592 INFO 9 --- [ocp-schedules-22,c40bc11fc4f5b0a4,3ec6c2055be34479] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2025-09-16 13:44:31.631 INFO 9 --- [ocp-schedules-4,1390769ac556e9a9,8b5bc17524174ebd] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:44:31.636 INFO 9 --- [prometheus-minute-schedule-1,b26156286057f538,bbbe1fb4329908bd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:31.639 INFO 9 --- [prometheus-minute-schedule-1,b26156286057f538,bbbe1fb4329908bd] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:31.658 INFO 9 --- [ocp-schedules-21,2c31dcc704355b39,0cf51ce3561cfa90] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:44:31.658 INFO 9 --- [ocp-schedules-21,2c31dcc704355b39,0cf51ce3561cfa90] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:44:31.661 INFO 9 --- [ocp-schedules-21,2c31dcc704355b39,0cf51ce3561cfa90] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:44:31.661 INFO 9 --- [ocp-schedules-21,2c31dcc704355b39,0cf51ce3561cfa90] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:44:31.663 INFO 9 --- [ocp-schedules-21,2c31dcc704355b39,0cf51ce3561cfa90] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:44:31.663 INFO 9 --- [ocp-schedules-21,2c31dcc704355b39,0cf51ce3561cfa90] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:44:31.688 INFO 9 --- [ocp-schedules-8,26c4f073bdcda812,8f8115e8b5460acf] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:44:31.689 INFO 9 --- [ocp-schedules-8,26c4f073bdcda812,8f8115e8b5460acf] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:31.703 INFO 9 --- [ocp-schedules-8,26c4f073bdcda812,8f8115e8b5460acf] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:44:32.756 WARN 9 --- [ocp-async-8,c160b0ec73e921e5,b6cf10f4a2a590c6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:32.756 INFO 9 --- [ocp-async-5,e90cb15131d5921a,bd993bb213910457] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:33.276 INFO 9 --- [ocp-schedules-3,c8f41215a6b19885,b172cc52a1e1f28c] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:44:33.372 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:33.373 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:33.397 INFO 9 --- [ocp-schedules-20,7d755eff08a66126,c8b878abcce493c2] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:44:33.397+08:00, clusters=[1] 2025-09-16 13:44:33.398 INFO 9 --- [ocp-schedules-20,7d755eff08a66126,c8b878abcce493c2] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:44:33.951 INFO 9 --- [ocp-schedules-24,298f1cca01e18b0b,42ddd6db0fd49ea4] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:44:33.951 INFO 9 --- [ocp-schedules-24,298f1cca01e18b0b,42ddd6db0fd49ea4] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:44:33.954 INFO 9 --- [ocp-schedules-24,298f1cca01e18b0b,42ddd6db0fd49ea4] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:44:33.969 INFO 9 --- [ocp-schedules-24,298f1cca01e18b0b,42ddd6db0fd49ea4] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:44:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:44:34.447 INFO 9 --- [ocp-schedules-14,dbaa8841715b3b82,a180b22b6b259f43] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:44:34.452 INFO 9 --- [ocp-schedules-14,dbaa8841715b3b82,a180b22b6b259f43] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:44:34.452 INFO 9 --- [ocp-schedules-14,dbaa8841715b3b82,a180b22b6b259f43] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:44:34.563 INFO 9 --- [ocp-schedules-9,6449c06312a15c43,0475e3d3e7aa82a8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:44:34.636 INFO 9 --- [prometheus-minute-schedule-1,6cbc8f1b462dfca6,c42d94732987dfca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:34.639 INFO 9 --- [prometheus-minute-schedule-1,6cbc8f1b462dfca6,c42d94732987dfca] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:34.756 WARN 9 --- [ocp-async-6,e98d36fcfa634e12,76524bb934c1a511] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:34.756 INFO 9 --- [ocp-async-3,1b8f63735c8f75af,7689d34e7e59ad06] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:35.416 INFO 9 --- [ocp-schedules-12,ca423eac0d9a68b9,a22de06b50ff6122] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:44:35.416+08:00, clusters=[1] 2025-09-16 13:44:35.426 INFO 9 --- [ocp-schedules-12,ca423eac0d9a68b9,a22de06b50ff6122] c.o.o.p.s.i.alarm.SlowSqlDataSource : query SlowSqlData of obCluster zhengqi, exclude result is empty. 2025-09-16 13:44:36.373 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:36.374 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:36.756 WARN 9 --- [ocp-async-2,1d535a63f0a3f60f,88681d53303de71a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:36.756 INFO 9 --- [ocp-async-9,7d3833bb9fb7afe2,5094dab4c1bfe6db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:37.449 INFO 9 --- [ocp-schedules-2,94d9ca971d7c67fe,6f82a8cf5c1f55b8] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:44:37.450 INFO 9 --- [ocp-schedules-2,94d9ca971d7c67fe,6f82a8cf5c1f55b8] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:37.472 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:37.472 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:44:37.485 INFO 9 --- [ocp-schedules-2,94d9ca971d7c67fe,6f82a8cf5c1f55b8] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:44:37.636 INFO 9 --- [prometheus-minute-schedule-1,018addcfe656c033,776cc0d2c1ea5259] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:37.639 INFO 9 --- [prometheus-minute-schedule-1,018addcfe656c033,776cc0d2c1ea5259] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:38.668 INFO 9 --- [ocp-schedules-30,c803714536283a9d,22b02aaea0ac7fc8] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:44:38.670 INFO 9 --- [ocp-schedules-30,c803714536283a9d,22b02aaea0ac7fc8] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:44:38.756 WARN 9 --- [ocp-async-4,cbc3bd86a321bf53,9ddd76fa643a5724] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:38.756 INFO 9 --- [ocp-async-8,566cd381784b8ea2,f7100aa8710f2dc2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:39.298 INFO 9 --- [ocp-schedules-18,64a359488efccac5,2c6266897e02bd53] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:44:39.303 WARN 9 --- [scanner-1358929-1,64a359488efccac5,73955eaa350668c5] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:44:39.313 INFO 9 --- [alarm-detect-20,64a359488efccac5,4cd9673c8f0e458e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:44:39.316 INFO 9 --- [alarm-detect-1,64a359488efccac5,f6b3f8dd915196a7] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:44:39.316 INFO 9 --- [alarm-detect-19,64a359488efccac5,48c271e58041eae3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:44:39.328 INFO 9 --- [alarm-detect-15,64a359488efccac5,80db4a0853585a95] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:44:39.374 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:39.374 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:39.417 INFO 9 --- [ocp-schedules-7,66253600b8e65708,44eb4782eb58e140] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:44:39.417 INFO 9 --- [ocp-schedules-7,66253600b8e65708,44eb4782eb58e140] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:44:39.426 INFO 9 --- [ocp-schedules-23,b0c703a8d45a5757,5b9ec6dcc53b9fc8] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:39.426 INFO 9 --- [ocp-schedules-23,b0c703a8d45a5757,5b9ec6dcc53b9fc8] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:44:39.426 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:44:39.426 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:44:39.426 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:44:39.426 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:44:39.430 INFO 9 --- [ocp-schedules-23,b0c703a8d45a5757,5b9ec6dcc53b9fc8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:44:39.430 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:44:39.430 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:44:39.430 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:44:39.430 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:39.431 INFO 9 --- [ocp-schedules-23,b0c703a8d45a5757,5b9ec6dcc53b9fc8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:39.431 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:44:39.431 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:44:39.431 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:44:39.431 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:39.431 INFO 9 --- [Collect all tenants major compactions1,66253600b8e65708,0240e195fd776d96] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:44:39.432 INFO 9 --- [Collect all tenants major compactions3,66253600b8e65708,701a1d2273387d9d] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:44:39.432 INFO 9 --- [Collect all tenants major compactions2,66253600b8e65708,80310ad318ed21f5] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:44:39.445 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:44:39.445 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:44:39.445 INFO 9 --- [ocp-schedules-23,b0c703a8d45a5757,5b9ec6dcc53b9fc8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:44:39.445 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:44:39.445 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:44:39.447 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:44:39.450 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:44:39.451 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:44:39.453 INFO 9 --- [Collect all tenants major compactions3,66253600b8e65708,701a1d2273387d9d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:39.453 INFO 9 --- [Collect all tenants major compactions1,66253600b8e65708,0240e195fd776d96] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:39.454 INFO 9 --- [Collect all tenants major compactions2,66253600b8e65708,80310ad318ed21f5] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:39.454 INFO 9 --- [Collect all tenants major compactions3,66253600b8e65708,701a1d2273387d9d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:44:39.455 INFO 9 --- [Collect all tenants major compactions1,66253600b8e65708,0240e195fd776d96] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:44:39.455 INFO 9 --- [Collect all tenants major compactions2,66253600b8e65708,80310ad318ed21f5] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:44:39.458 INFO 9 --- [Collect all tenants major compactions3,66253600b8e65708,701a1d2273387d9d] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:44:39.459 INFO 9 --- [Collect all tenants major compactions1,66253600b8e65708,0240e195fd776d96] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:44:39.464 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:44:39.466 INFO 9 --- [ocp-schedules-23,b0c703a8d45a5757,5b9ec6dcc53b9fc8] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:44:39.468 INFO 9 --- [Collect all tenants major compactions2,66253600b8e65708,80310ad318ed21f5] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:44:39.468 INFO 9 --- [ocp-schedules-7,66253600b8e65708,44eb4782eb58e140] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:44:40.002 INFO 9 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:44:40.002 INFO 9 --- [ocp-schedules-22,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:44:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:44:40.003946+08:00, lastProcessTime=2025-09-16T13:44:30.003583+08:00 2025-09-16 13:44:40.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:44:40.003946+08:00 2025-09-16 13:44:40.176 INFO 9 --- [ocp-async-1,7b46587c8d058b70,7166d1dfd8bf5d57] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:44:40.636 INFO 9 --- [prometheus-minute-schedule-1,94c987a101944ee5,c8ffe554d0a87f6e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:40.639 INFO 9 --- [prometheus-minute-schedule-1,94c987a101944ee5,c8ffe554d0a87f6e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:40.757 WARN 9 --- [ocp-async-6,2277c33e75fe71c9,e0b11117d672b21a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:40.757 INFO 9 --- [ocp-async-3,ab456da1c8a39d2d,53cfbfe26e53bd3c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:41.151 INFO 9 --- [ocp-schedules-30,9c3d6538ffdc5ae2,5a104af96a04ff36] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:44:41.152 INFO 9 --- [ocp-schedules-30,9c3d6538ffdc5ae2,5a104af96a04ff36] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:41.202 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:44:41.202 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.205 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:44:41.237 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.238 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:44:41.258 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.259 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:44:41.285 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.285 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:44:41.287 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.288 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:44:41.309 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.309 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:44:41.332 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.333 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:44:41.337 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.338 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:44:41.361 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.361 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:44:41.385 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.385 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:44:41.403 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.404 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:44:41.405 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.406 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:44:41.407 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.407 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:44:41.408 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.409 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:44:41.410 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.410 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:44:41.411 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.412 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:44:41.428 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.429 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:44:41.429 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.430 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:44:41.431 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.431 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:44:41.446 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:44:41.449 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:44:41.476 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:44:41.477 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.478 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:44:41.504 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:44:41.504 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:44:41.504 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:44:41.504 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:44:41.504 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:44:41.504 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:44:41.506 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:44:41.506 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:44:41.506 INFO 9 --- [ocp-schedules-30,9c3d6538ffdc5ae2,5a104af96a04ff36] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:44:41.784 INFO 9 --- [ocp-schedules-2,da2b6ff3a300a758,3436ca4933336ce3] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:44:41.784 INFO 9 --- [ocp-schedules-2,da2b6ff3a300a758,3436ca4933336ce3] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:44:41.821 INFO 9 --- [ocp-schedules-2,da2b6ff3a300a758,3436ca4933336ce3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:41.822 INFO 9 --- [ocp-schedules-2,da2b6ff3a300a758,3436ca4933336ce3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:44:42.374 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:42.375 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:42.757 WARN 9 --- [ocp-async-1,6471fd33d3aa3a97,8b739a270e2102cc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:42.757 INFO 9 --- [ocp-async-9,e507ae59e146e052,1a7df31b6c6cdaf6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:44:42,888 |-INFO in ReconfigureOnChangeTask(born:1758001422888) - Empty watch file list. Disabling 2025-09-16 13:44:43.636 INFO 9 --- [prometheus-minute-schedule-1,16d54703d525b95d,341656b332dbe1da] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:43.639 INFO 9 --- [prometheus-minute-schedule-1,16d54703d525b95d,341656b332dbe1da] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:44.566 INFO 9 --- [ocp-schedules-10,cb98c09eef3a7d7c,14c8b85b356586b7] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:44:44.757 WARN 9 --- [ocp-async-10,11c665d35ebcc693,fce76b97793132af] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:44.757 INFO 9 --- [ocp-async-8,b9a5502025c0f02e,935951c507e96d64] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:45.375 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:45.376 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:46.636 INFO 9 --- [prometheus-minute-schedule-1,cfc5a1551ccec027,417b32530508b724] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:46.640 INFO 9 --- [prometheus-minute-schedule-1,cfc5a1551ccec027,417b32530508b724] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:46.757 WARN 9 --- [ocp-async-7,1564f12eacee2e68,caab47ec5ad8b39c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:46.757 INFO 9 --- [ocp-async-6,a49bd8a66156970b,391f548a50952427] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:48.376 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:48.377 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:48.675 INFO 9 --- [ocp-schedules-2,36747c99efbbdf00,e0f2204a6f054079] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:44:48.677 INFO 9 --- [ocp-schedules-2,36747c99efbbdf00,e0f2204a6f054079] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:44:48.757 WARN 9 --- [ocp-async-3,2598452e1561597a,8958d549388f6677] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:48.757 INFO 9 --- [ocp-async-1,f53c8fef119ecfd5,4b2199fe164e9fa0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:49.224 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.225 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:49.226 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.227 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:49.228 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:44:49.241 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:44:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:44:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:44:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:44:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:44:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:44:49.257 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.257 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.257 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.257 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.257 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.258 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:49.258 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:49.258 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:49.258 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:49.258 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:49.259 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.259 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.259 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:44:49.260 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.260 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.260 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:49.260 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:44:49.260 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:44:49.260 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:44:49.260 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:44:49.281 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:40:00, end=2025-09-16T13:42:30, updates=78, granule=120000ms, delay=150000ms 2025-09-16 13:44:49.282 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:40:00, end=2025-09-16T13:42:30, updates=71, granule=120000ms, delay=150000ms 2025-09-16 13:44:49.285 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:40:00, end=2025-09-16T13:42:30, updates=99, granule=120000ms, delay=150000ms 2025-09-16 13:44:49.287 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:42:30, granule=120000ms, delay=0ms) 2025-09-16 13:44:49.287 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:40:00, end=2025-09-16T13:42:30, updates=167, granule=120000ms, delay=150000ms 2025-09-16 13:44:49.289 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:42:30, granule=120000ms, delay=0ms) 2025-09-16 13:44:49.291 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:42:30, granule=120000ms, delay=0ms) 2025-09-16 13:44:49.291 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:40:00, end=2025-09-16T13:42:30, updates=183, granule=120000ms, delay=150000ms 2025-09-16 13:44:49.292 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:42:30, granule=120000ms, delay=0ms) 2025-09-16 13:44:49.296 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:42:30, granule=120000ms, delay=0ms) 2025-09-16 13:44:49.330 INFO 9 --- [ocp-schedules-22,2eaf6919cc74016b,81207d183cd62ead] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:44:49.335 WARN 9 --- [scanner-1359092-1,2eaf6919cc74016b,66f6e030ed017387] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:44:49.359 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=1->2, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:27:30, end=2025-09-16T13:37:30, updates=95, granule=600000ms, delay=900000ms 2025-09-16 13:44:49.359 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=1->2, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:27:30, end=2025-09-16T13:37:30, updates=162, granule=600000ms, delay=900000ms 2025-09-16 13:44:49.362 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=1->2, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:27:30, end=2025-09-16T13:37:30, updates=128, granule=600000ms, delay=900000ms 2025-09-16 13:44:49.362 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=1->2, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:27:30, end=2025-09-16T13:37:30, updates=179, granule=600000ms, delay=900000ms 2025-09-16 13:44:49.363 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:44:49.363 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:44:49.367 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:44:49.367 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:44:49.370 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=1->2, c=0) - source=2025-09-16T13:42:30, start=2025-09-16T13:27:30, end=2025-09-16T13:37:30, updates=234, granule=600000ms, delay=900000ms 2025-09-16 13:44:49.373 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:44:49.373 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=145ms, period=120000ms 2025-09-16 13:44:49.636 INFO 9 --- [prometheus-minute-schedule-1,b1c826961af2d186,98a5b032516f8459] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:49.639 INFO 9 --- [prometheus-minute-schedule-1,b1c826961af2d186,98a5b032516f8459] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:44:50.003276+08:00, lastProcessTime=2025-09-16T13:44:40.003946+08:00 2025-09-16 13:44:50.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:44:50.003276+08:00 2025-09-16 13:44:50.176 INFO 9 --- [ocp-async-2,ba12545e4500a645,e56a9503c1a33239] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:44:50.757 WARN 9 --- [ocp-async-10,b06fd6d254bc1c63,f4fcdaf2b659236a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:50.757 INFO 9 --- [ocp-async-5,3035a06a73284d3c,d2317251e90f1872] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:51.377 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:51.378 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:52.636 INFO 9 --- [prometheus-minute-schedule-1,01f6acd915d7f303,7b32a64e5b2655ab] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:52.640 INFO 9 --- [prometheus-minute-schedule-1,01f6acd915d7f303,7b32a64e5b2655ab] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:52.757 WARN 9 --- [ocp-async-2,80468eead4f8f807,0b2f1bdfe032c19b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:52.757 INFO 9 --- [ocp-async-7,babccfc97bfc6375,33a651d90ef051b9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:54.378 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:54.379 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:54.454 INFO 9 --- [ocp-schedules-21,138415c278be1790,5fe5acddbc2f72f1] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:44:54.458 INFO 9 --- [ocp-schedules-21,138415c278be1790,5fe5acddbc2f72f1] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:44:54.459 INFO 9 --- [ocp-schedules-21,138415c278be1790,5fe5acddbc2f72f1] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:44:54.569 INFO 9 --- [ocp-schedules-5,3f9682b27ee2b3c7,bfd14ee1dd875bf9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:44:54.757 WARN 9 --- [ocp-async-3,dd7cb2782280dd02,21d618e5c34a561b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:54.757 INFO 9 --- [ocp-async-4,b29c8b7d01fc2318,e01f954bdf2fca7e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:55.636 INFO 9 --- [prometheus-minute-schedule-1,28ec5f4510560acf,a75d60db8b112ef9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:55.639 INFO 9 --- [prometheus-minute-schedule-1,28ec5f4510560acf,a75d60db8b112ef9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:56.758 INFO 9 --- [ocp-async-9,4958067fe458ef84,acb5ac2f537f8701] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:56.758 WARN 9 --- [ocp-async-10,560a24a0d4a14cca,58f27d021efdaadc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:56.791 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,ca0ac02744818887,d2c0569452dcfcd5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=ca0ac02744818887, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:44:56.792 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,ca0ac02744818887,d2c0569452dcfcd5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=ca0ac02744818887, duration=1 ms] 2025-09-16 13:44:57.379 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:44:57.379 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:44:58.636 INFO 9 --- [prometheus-minute-schedule-1,0f0bc4700516e694,7140d97dd3ca8828] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001500, interval=60 2025-09-16 13:44:58.639 INFO 9 --- [prometheus-minute-schedule-1,0f0bc4700516e694,7140d97dd3ca8828] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:44:58.681 INFO 9 --- [ocp-schedules-21,76089d1528819647,f3a62073bafbe382] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:44:58.683 INFO 9 --- [ocp-schedules-21,76089d1528819647,f3a62073bafbe382] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:44:58.758 WARN 9 --- [ocp-async-9,2734442291a80cbc,d95dff1ac7b67036] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:44:58.758 INFO 9 --- [ocp-async-5,0bcdcfeba732a52f,277336ece5994851] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:44:59.360 INFO 9 --- [ocp-schedules-25,46033b5112013f98,2369cc1649955472] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:44:59.366 WARN 9 --- [scanner-1359227-1,46033b5112013f98,6042d1ef173c286d] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:44:59.376 INFO 9 --- [alarm-detect-6,46033b5112013f98,5076f9af755c33a1] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:44:59.378 INFO 9 --- [alarm-detect-1,46033b5112013f98,c638ced38318cbee] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:44:59.378 INFO 9 --- [alarm-detect-9,46033b5112013f98,73cc9bcf5c070254] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:44:59.391 INFO 9 --- [alarm-detect-17,46033b5112013f98,51c6cd6f94385b2f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:44:59.938 INFO 9 --- [ocp-schedules-5,b49a07e00459f85b,7db8ea819152e816] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:44:59.941 INFO 9 --- [ocp-schedules-21,7cda6d1e66d17d95,66666dfa687af1b9] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:44:59.941 INFO 9 --- [ocp-schedules-5,7b9c8d81aac141e3,ef9a2f0e2d46d179] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:44:59.942 INFO 9 --- [ocp-schedules-7,9e4aec7afebc0795,844cc4b96225a8af] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:44:59.943 INFO 9 --- [ocp-schedules-5,7b9c8d81aac141e3,ef9a2f0e2d46d179] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:59.943 INFO 9 --- [ocp-schedules-21,7cda6d1e66d17d95,66666dfa687af1b9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:59.943 INFO 9 --- [ocp-schedules-7,9e4aec7afebc0795,844cc4b96225a8af] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:44:59.944 INFO 9 --- [ocp-schedules-7,9e4aec7afebc0795,844cc4b96225a8af] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:44:59.944 INFO 9 --- [ocp-schedules-16,e7677b65abc1a625,ca597bcc92834e22] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:59.944 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:44:59.944 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [ocp-schedules-15,16db487768e56d1a,e22020b8e5349dbb] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:59.945 INFO 9 --- [ocp-schedules-3,3e221f62a207e79c,c33bad3c046a9784] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:44:59.945 INFO 9 --- [host-check-agent-status1,16db487768e56d1a,02f6392250d4df04] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-agent-status2,16db487768e56d1a,df78f8a8f0c6483d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-clockdiff1,3e221f62a207e79c,54e1e5cc4efbf783] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:44:59.945 INFO 9 --- [host-check-agent-status3,16db487768e56d1a,08ce93b41a6e2d88] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-clockdiff2,3e221f62a207e79c,e4778f75b31f0c58] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:44:59.945 INFO 9 --- [host-check-clockdiff3,3e221f62a207e79c,d93f42fdcf874946] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:44:59.945 INFO 9 --- [host-check-clockdiff4,3e221f62a207e79c,fe17aee34fd14dec] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:44:59.945 INFO 9 --- [host-check-agent-status4,16db487768e56d1a,a099704633e7766d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:44:59.945 INFO 9 --- [host-check-clockdiff5,3e221f62a207e79c,5d578a526f780c22] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:44:59.946 INFO 9 --- [host-check-clockdiff6,3e221f62a207e79c,c0b350b6f6fc4a61] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:44:59.946 INFO 9 --- [host-check-agent-status5,16db487768e56d1a,5dfefa29a44063fd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:44:59.946 INFO 9 --- [host-check-agent-status6,16db487768e56d1a,60ef7689b443e710] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:44:59.951 INFO 9 --- [ocp-schedules-9,23422295a73e82cb,b8754471c9f27e9a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:44:59.952 INFO 9 --- [host-check-agent-status2,16db487768e56d1a,df78f8a8f0c6483d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:44:59.952 INFO 9 --- [host-check-clockdiff6,3e221f62a207e79c,c0b350b6f6fc4a61] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001499 -1 -1 , error= 2025-09-16 13:44:59.952 INFO 9 --- [host-check-clockdiff3,3e221f62a207e79c,d93f42fdcf874946] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001499 -1 -1 , error= 2025-09-16 13:44:59.952 INFO 9 --- [host-check-clockdiff5,3e221f62a207e79c,5d578a526f780c22] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001499 -1 -1 , error= 2025-09-16 13:44:59.952 INFO 9 --- [host-check-clockdiff2,3e221f62a207e79c,e4778f75b31f0c58] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001499 -1 -1 , error= 2025-09-16 13:44:59.952 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:59.952 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:44:59.952 INFO 9 --- [host-check-agent-status1,16db487768e56d1a,02f6392250d4df04] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:44:59.952 INFO 9 --- [host-check-agent-status5,16db487768e56d1a,5dfefa29a44063fd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:44:59.952 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:44:59.952 INFO 9 --- [host-check-agent-status3,16db487768e56d1a,08ce93b41a6e2d88] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:44:59.952 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:44:59.952 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:44:59.952 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:44:59.953 INFO 9 --- [host-check-agent-status2,16db487768e56d1a,df78f8a8f0c6483d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:44:59.953 INFO 9 --- [host-check-clockdiff4,3e221f62a207e79c,fe17aee34fd14dec] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001499 -1 -1 , error= 2025-09-16 13:44:59.954 INFO 9 --- [host-check-agent-status3,16db487768e56d1a,08ce93b41a6e2d88] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:44:59.954 INFO 9 --- [host-check-agent-status1,16db487768e56d1a,02f6392250d4df04] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:44:59.954 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:59.954 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:44:59.954 INFO 9 --- [host-check-agent-status6,16db487768e56d1a,60ef7689b443e710] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:59.955 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:59.955 INFO 9 --- [host-check-agent-status4,16db487768e56d1a,a099704633e7766d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:44:59.955 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:44:59.955 INFO 9 --- [host-check-agent-status5,16db487768e56d1a,5dfefa29a44063fd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:44:59.955 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:44:59.955 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:44:59.955 INFO 9 --- [host-check-agent-status6,16db487768e56d1a,60ef7689b443e710] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:59.956 INFO 9 --- [host-check-agent-status4,16db487768e56d1a,a099704633e7766d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:59.968 INFO 9 --- [host-check-agent-status2,16db487768e56d1a,df78f8a8f0c6483d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:44:59.969 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:44:59.969 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:44:59.969 INFO 9 --- [host-check-agent-status3,16db487768e56d1a,08ce93b41a6e2d88] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:44:59.969 INFO 9 --- [host-check-agent-status1,16db487768e56d1a,02f6392250d4df04] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:44:59.970 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:44:59.970 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:44:59.970 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:59.970 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:44:59.970 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:44:59.969511569+08:00 2025-09-16 13:44:59.970 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:44:59.969929793+08:00 2025-09-16 13:44:59.971 INFO 9 --- [host-check-agent-status6,16db487768e56d1a,60ef7689b443e710] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:44:59.971 INFO 9 --- [host-check-agent-status5,16db487768e56d1a,5dfefa29a44063fd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:44:59.971 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:44:59.970+08:00 2025-09-16 13:44:59.971 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:44:59.970+08:00 2025-09-16 13:44:59.971 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:44:59.971 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:44:59.971 INFO 9 --- [host-check-agent-status4,16db487768e56d1a,a099704633e7766d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:44:59.971 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:44:59.970541831+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:44:59.971148985+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:44:59.970773037+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:44:59.971+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:44:59.972+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:44:59.971225605+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:44:59.972+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:44:59.970+08:00 and status AVAILABLE 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:44:59.972+08:00 2025-09-16 13:44:59.972 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:44:59.970+08:00 and status AVAILABLE 2025-09-16 13:44:59.973 INFO 9 --- [host-check-agent-status2,16db487768e56d1a,df78f8a8f0c6483d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:44:59.973 INFO 9 --- [host-check-agent-status2,16db487768e56d1a,df78f8a8f0c6483d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:44:59.973 INFO 9 --- [host-check-agent-status2,16db487768e56d1a,df78f8a8f0c6483d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:44:59.973 INFO 9 --- [host-check-agent-status3,16db487768e56d1a,08ce93b41a6e2d88] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:44:59.973 INFO 9 --- [host-check-agent-status3,16db487768e56d1a,08ce93b41a6e2d88] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:44:59.973 INFO 9 --- [host-check-agent-status3,16db487768e56d1a,08ce93b41a6e2d88] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:44:59.973 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:44:59.971+08:00 and status AVAILABLE 2025-09-16 13:44:59.974 INFO 9 --- [host-check-agent-status6,16db487768e56d1a,60ef7689b443e710] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:44:59.974 INFO 9 --- [host-check-agent-status6,16db487768e56d1a,60ef7689b443e710] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:44:59.974 INFO 9 --- [host-check-agent-status6,16db487768e56d1a,60ef7689b443e710] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:44:59.974 INFO 9 --- [host-check-agent-status1,16db487768e56d1a,02f6392250d4df04] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:44:59.974 INFO 9 --- [host-check-agent-status1,16db487768e56d1a,02f6392250d4df04] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:44:59.974 INFO 9 --- [host-check-agent-status1,16db487768e56d1a,02f6392250d4df04] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:44:59.974 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:44:59.972+08:00 and status AVAILABLE 2025-09-16 13:44:59.974 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:44:59.972+08:00 and status AVAILABLE 2025-09-16 13:44:59.974 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:44:59.972+08:00 and status AVAILABLE 2025-09-16 13:44:59.975 INFO 9 --- [host-check-agent-status5,16db487768e56d1a,5dfefa29a44063fd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:44:59.975 INFO 9 --- [host-check-agent-status5,16db487768e56d1a,5dfefa29a44063fd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:44:59.975 INFO 9 --- [host-check-agent-status5,16db487768e56d1a,5dfefa29a44063fd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:44:59.975 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:44:59.975 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:44:59.976 INFO 9 --- [host-check-agent-status4,16db487768e56d1a,a099704633e7766d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:44:59.976 INFO 9 --- [host-check-agent-status4,16db487768e56d1a,a099704633e7766d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:44:59.976 INFO 9 --- [host-check-agent-status4,16db487768e56d1a,a099704633e7766d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:44:59.976 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:44:59.976 INFO 9 --- [ocp-schedules-5,7b9c8d81aac141e3,ef9a2f0e2d46d179] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:44:59.977 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:44:59.977 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:44:59.977 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:44:59.977 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:44:59.981 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:44:59.982 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:44:59.982 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:44:59.983 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:44:59.983 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:44:59.983 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:44:59.983 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:44:59.983 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:44:59.983 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:44:59.984 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:44:59.984 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:44:59.984 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:44:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:44:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:44:59.996 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:59.996 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:59.997 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:59.997 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:59.997 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:44:59.998 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:45:00.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:45:00.002629+08:00, lastProcessTime=2025-09-16T13:44:50.003276+08:00 2025-09-16 13:45:00.024 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:45:00.024 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:45:00.025 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:45:00.026 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:45:00.029 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:45:00.031 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:45:00.031 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:45:00.031 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:45:00.032 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:45:00.032 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:45:00.036 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:45:00.039 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:45:00.043 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:00.044 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:00.044 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:00.044 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:00.048 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:00.050 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:00.054 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:00.055 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:00.056 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:45:00.071 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:45:00.071 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:45:00.072 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:45:00.075 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:45:00.078 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:45:00.078 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:45:00.078 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:45:00.078 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:45:00.079 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:45:00.082 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:45:00.085 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:45:00.086 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:45:00.091 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:00.091 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:00.092 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:00.092 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:00.092 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:00.093 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:00.093 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:45:00.096 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:00.096 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:00.097 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:00.099 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:45:00.100 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:00.114 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.114 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:00.119 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:45:00.119 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:45:00.121 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:45:00.124 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:45:00.125 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:45:00.126 INFO 9 --- [host-check-host-status2,e7677b65abc1a625,cff73741b1c5c873] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:45:00.126 INFO 9 --- [host-check-host-status5,e7677b65abc1a625,a28ed60b91e3127c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:45:00.127 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:45:00.127 INFO 9 --- [host-check-host-status6,e7677b65abc1a625,5853c9b33ebdf8fe] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:45:00.131 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.131 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:00.131 INFO 9 --- [host-check-host-status4,e7677b65abc1a625,ebbc00074c1e5869] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:45:00.131 INFO 9 --- [host-check-host-status3,e7677b65abc1a625,f5dc6fc95c859536] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:45:00.134 INFO 9 --- [host-check-host-status1,e7677b65abc1a625,d9016435365b769f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:45:00.137 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:45:00.002629+08:00 2025-09-16 13:45:00.144 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.144 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:00.160 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.160 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:00.173 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.173 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:00.176 INFO 9 --- [ocp-async-10,fde79c1bcfd9c1f1,dff33002309aeae3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:45:00.188 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.188 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:00.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:00.217 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.217 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:00.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:00.246 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:00.260 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:00.261 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:00.262 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:45:00.267 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:45:00.270 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:45:00.273 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:00.274 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:00.287 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:45:00.355 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:45:00.369 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:00.371 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:00.372 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:45:00.380 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:00.380 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:00.387 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:45:00.387 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:45:00.387 INFO 9 --- [ocp-schedules-21,7cda6d1e66d17d95,66666dfa687af1b9] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:45:00.758 WARN 9 --- [ocp-async-7,ddb9dddbc4feafb2,3022ac1e70a7b36f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:00.758 INFO 9 --- [ocp-async-3,1f3035918a582774,0701ad08a157b05a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:00.807 INFO 9 --- [ocp-schedules-9,5dde0a476cf56bf0,2ae79ecfcd85c9a3] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:45:00.886 INFO 9 --- [host-check-clockdiff1,3e221f62a207e79c,54e1e5cc4efbf783] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001500 -1 -1 , error= 2025-09-16 13:45:00.977 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:40:00.0, nextRun=2025-09-16 13:45:00.0, currentDate=Tue Sep 16 13:45:00 CST 2025 2025-09-16 13:45:00.977 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999977, name=DiagFuncUpdateSchedule, templateName=DiagFuncUpdateSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:40:00.0, nextRunTime=2025-09-16 13:45:00.0} 2025-09-16 13:45:00.980 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=DiagFuncUpdateSchedule, nodeCount=1, taskCount=1 2025-09-16 13:45:00.980 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='DiagFuncUpdateSchedule', taskDefinitionId=999977, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T13:45:00.980+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Update diag function, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.diagnosis.task.DiagFuncUpdateTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 13:45:00.988 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:40:00.0, nextRun=2025-09-16 13:45:00.0, currentDate=Tue Sep 16 13:45:00 CST 2025 2025-09-16 13:45:00.988 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:40:00.0, nextRunTime=2025-09-16 13:45:00.0} 2025-09-16 13:45:01.000 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[1] 2025-09-16 13:45:01.004 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.p.s.internal.SqlParseTaskSchedule : HighRiskSql Parse is ready 2025-09-16 13:45:01.006 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=SqlParseTaskSchedule, nodeCount=1, taskCount=1 2025-09-16 13:45:01.006 INFO 9 --- [task-coordinator3,25e389618b93fdc9,e8e101786d0bfc96] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='SqlParseTaskSchedule', taskDefinitionId=999985, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={cluster_ids=[[1]]}}, createTime=null, startTime=2025-09-16T13:45:01.006+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Sql Parse Task, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.task.SqlParseTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 13:45:01.559 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,1654e3932f1570eb] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1342, operation:EXECUTE, state: RUNNING 2025-09-16 13:45:01.566 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,1654e3932f1570eb] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1343, operation:EXECUTE, state: RUNNING 2025-09-16 13:45:01.570 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 13:45:01.571 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1342, context=Context{parallelIdx=-1, stringMap={task_instance_id=815, task_operation=execute, latest_execution_start_time=2025-09-16T13:45:01.555+08:00, sub_task_instance_name=Update diag function, sub_task_instance_id=1342}, listMap={}}, executor=10.233.116.22 2025-09-16 13:45:01.576 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 13:45:01.578 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1343, context=Context{parallelIdx=0, stringMap={subtask_splitter=cluster_ids, task_instance_id=816, task_operation=execute, latest_execution_start_time=2025-09-16T13:45:01.565+08:00, sub_task_instance_name=Sql Parse Task, sub_task_instance_id=1343}, listMap={cluster_ids=[[1]]}}, executor=10.233.116.22 2025-09-16 13:45:01.578 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.o.p.sql.internal.task.SqlParseTask : parse sql for cluster:1 2025-09-16 13:45:01.586 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.621 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1002,1757980800000000,2000,30000000 2025-09-16 13:45:01.624 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.o.perf.sql.internal.SqlParseService : parse 0 sqls for tenant:ObTenantEntity{id=2, name=cos, obTenantId=1002, status=NORMAL} 2025-09-16 13:45:01.635 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.636 INFO 9 --- [prometheus-minute-schedule-1,4a745fd615cbffc4,93b49b125d2c6cdb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:01.639 INFO 9 --- [prometheus-minute-schedule-1,4a745fd615cbffc4,93b49b125d2c6cdb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:01.654 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1004,1757980800000000,2000,30000000 2025-09-16 13:45:01.657 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.o.perf.sql.internal.SqlParseService : parse 2 sqls for tenant:ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL} 2025-09-16 13:45:01.663 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.700 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.725 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.749 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.761 INFO 9 --- [subtask-executor31,25e389618b93fdc9,b05db6cbef67d006] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1343, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 13:45:01.774 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.783 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.o.DiskUsageTimeRemainingOperator : no metrics data, skip predicting for zhengqi 2025-09-16 13:45:01.784 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:45:01.833 INFO 9 --- [subtask-executor30,25e389618b93fdc9,cb3e43b83c3d3949] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1342, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 13:45:02.348 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:815, status:SUCCESS 2025-09-16 13:45:02.348 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:815, status:SUCCESS 2025-09-16 13:45:02.354 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:816, status:SUCCESS 2025-09-16 13:45:02.354 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:816, status:SUCCESS 2025-09-16 13:45:02.758 WARN 9 --- [ocp-async-3,d8668f8e3a1f62a5,a442b45fc69c349c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:02.758 INFO 9 --- [ocp-async-10,5a0dbc64bda61aa2,65eee4792c43b59a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:03.380 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:03.381 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:04.573 INFO 9 --- [ocp-schedules-11,49976e189363ecbd,077dbb93637d209d] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:45:04.636 INFO 9 --- [prometheus-minute-schedule-1,744295b451afd358,16507cc7778c10bb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:04.639 INFO 9 --- [prometheus-minute-schedule-1,744295b451afd358,16507cc7778c10bb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:04.758 WARN 9 --- [ocp-async-10,1f0a9e498afcb0d4,662d23736845aa3d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:04.758 INFO 9 --- [ocp-async-6,e475573e1ed0ce40,3b6236e9ab192011] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:06.381 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:06.382 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:06.758 WARN 9 --- [ocp-async-6,4fbb8266e8a8d3a8,5e5091acee5ae2f6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:06.758 INFO 9 --- [ocp-async-7,07b63e0d0d371524,2e5f6cebda24e115] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:07.636 INFO 9 --- [prometheus-minute-schedule-1,205a39ea0d60cd7c,090cc634121cfcd9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:07.639 INFO 9 --- [prometheus-minute-schedule-1,205a39ea0d60cd7c,090cc634121cfcd9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:08.688 INFO 9 --- [ocp-schedules-15,62a6ee72ccb5329f,0cb43ab12ffb5722] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:45:08.690 INFO 9 --- [ocp-schedules-15,62a6ee72ccb5329f,0cb43ab12ffb5722] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:45:08.758 WARN 9 --- [ocp-async-7,974d8e5bd34f399d,badaed09d3d63994] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:08.758 INFO 9 --- [ocp-async-3,4e5d923d8d8a93de,8adaa958f54019de] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:09.382 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:09.382 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:09.393 INFO 9 --- [ocp-schedules-14,b8ec575331775f09,e08a86e96629a829] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:45:09.398 WARN 9 --- [scanner-1359486-1,b8ec575331775f09,f9a23a4ddae207a1] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:45:10.002 INFO 9 --- [ocp-schedules-3,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:45:10.002 INFO 9 --- [ocp-schedules-2,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:45:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:45:10.003455+08:00, lastProcessTime=2025-09-16T13:45:00.002629+08:00 2025-09-16 13:45:10.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:45:10.003455+08:00 2025-09-16 13:45:10.177 INFO 9 --- [ocp-async-4,103a0e9406119784,7d001deef21a8999] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:45:10.296 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:45:10.636 INFO 9 --- [prometheus-minute-schedule-1,8ca6299ef1baa192,81931384e6ef80db] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:10.639 INFO 9 --- [prometheus-minute-schedule-1,8ca6299ef1baa192,81931384e6ef80db] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:10.758 WARN 9 --- [ocp-async-10,71441baa8007b5db,ce22086772a779c8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:10.758 INFO 9 --- [ocp-async-10,4894028b594f674e,2182c36dca7029c3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:11.685 INFO 9 --- [metric-archive-async-4,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001440, nodeCount=215, affectRows=215 2025-09-16 13:45:11.687 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001440, nodeCount=248, affectRows=248 2025-09-16 13:45:12.383 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:12.383 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:12.758 WARN 9 --- [ocp-async-6,189ffc5500f47301,3102a8a23100bea9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:12.759 INFO 9 --- [ocp-async-1,2c37b5da9c74979b,3b752eb876316aa2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:13.636 INFO 9 --- [prometheus-minute-schedule-1,7ef8f4bdd1d21259,e228b87f2abd9276] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:13.639 INFO 9 --- [prometheus-minute-schedule-1,7ef8f4bdd1d21259,e228b87f2abd9276] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:14.460 INFO 9 --- [ocp-schedules-19,90df67cbdaf4ae76,f79f121a011fb72f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:45:14.465 INFO 9 --- [ocp-schedules-19,90df67cbdaf4ae76,f79f121a011fb72f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:45:14.465 INFO 9 --- [ocp-schedules-19,90df67cbdaf4ae76,f79f121a011fb72f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:45:14.576 INFO 9 --- [ocp-schedules-29,81e5429259c423e7,6b94a990eddd4245] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:45:14.759 WARN 9 --- [ocp-async-7,8b7d5d5d89822ba0,8b42608f58a2e2dd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:14.759 INFO 9 --- [ocp-async-8,68c3ee7aa6c6daea,1efc44bd68a5dde2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:15.229 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001440, nodeCount=1000, affectRows=1000 2025-09-16 13:45:15.231 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001440, nodeCount=1000, validCount=996 2025-09-16 13:45:15.255 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001440, nodeCount=1000, affectRows=1000 2025-09-16 13:45:15.258 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001440, nodeCount=1000, validCount=998 2025-09-16 13:45:15.269 ERROR 9 --- [metric-archive-second-2,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221682509) Duplicate entry '824401952469598208-1758001380' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221682509) Duplicate entry '824401952469598208-1758001380' for key 'PRIMARY' 2025-09-16 13:45:15.383 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:15.384 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:15.405 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001440, nodeCount=277, affectRows=277 2025-09-16 13:45:15.405 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001440, nodeCount=276, affectRows=276 2025-09-16 13:45:15.405 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001440, nodeCount=300, affectRows=300 2025-09-16 13:45:15.406 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001440, nodeCount=277, validCount=276 2025-09-16 13:45:15.406 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001440, nodeCount=276, validCount=276 2025-09-16 13:45:15.406 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001440, nodeCount=300, validCount=299 2025-09-16 13:45:16.538 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001440, nodeCount=1000, affectRows=1000 2025-09-16 13:45:16.541 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001440, nodeCount=992, validCount=946 2025-09-16 13:45:16.636 INFO 9 --- [prometheus-minute-schedule-1,fa44c604762b288a,c53be9c1cdf5e890] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:16.639 INFO 9 --- [prometheus-minute-schedule-1,fa44c604762b288a,c53be9c1cdf5e890] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:16.759 WARN 9 --- [ocp-async-9,3457d1e6d0a87842,242c574a6330e86b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:16.759 INFO 9 --- [ocp-async-5,acf75e952d0941a6,5645e643fe4719ee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:18.384 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:18.385 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:18.694 INFO 9 --- [ocp-schedules-8,809674afcc7106dc,24c7cb757c3eb7b7] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:45:18.696 INFO 9 --- [ocp-schedules-8,809674afcc7106dc,24c7cb757c3eb7b7] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:45:18.759 INFO 9 --- [ocp-async-6,13b974b5b0c49f5c,efcbd8c693723ce1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:18.759 WARN 9 --- [ocp-async-4,803c869fc7d3429e,43be13f5c24efcbf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:19.419 INFO 9 --- [ocp-schedules-10,758775d629a81e50,681e007929fed1e5] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:45:19.423 WARN 9 --- [scanner-1360479-1,758775d629a81e50,c33fc82e3031d953] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:45:19.434 INFO 9 --- [alarm-detect-11,758775d629a81e50,ec46d745c2958494] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:45:19.437 INFO 9 --- [alarm-detect-18,758775d629a81e50,35406043c79eefe3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:45:19.437 INFO 9 --- [alarm-detect-2,758775d629a81e50,9318562fb93d9a49] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:45:19.450 INFO 9 --- [alarm-detect-1,758775d629a81e50,f1078e8229466b40] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:45:19.636 INFO 9 --- [prometheus-minute-schedule-1,2dd660254ec39fa8,e649cdeeaddf812c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:19.639 INFO 9 --- [prometheus-minute-schedule-1,2dd660254ec39fa8,e649cdeeaddf812c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:45:20.004107+08:00, lastProcessTime=2025-09-16T13:45:10.003455+08:00 2025-09-16 13:45:20.144 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:45:20.004107+08:00 2025-09-16 13:45:20.177 INFO 9 --- [ocp-async-9,caca9a9c6c3958ee,890d6eb87ebc03f2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:45:20.636 INFO 9 --- [prometheus-cache-monitor1,fb22711d2984a0cd,93679a7e7f618cff] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:45:20.636 INFO 9 --- [prometheus-cache-monitor1,fb22711d2984a0cd,93679a7e7f618cff] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:45:20.759 INFO 9 --- [ocp-async-2,f434517e43cbac7b,e5169c289616f2e3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:20.759 WARN 9 --- [ocp-async-8,ba648e4a2eb9ece0,e90287298d4a0cbc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:21.385 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:21.386 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:22.636 INFO 9 --- [prometheus-minute-schedule-1,025c4de5702999b3,d039c637a9de4839] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:22.639 INFO 9 --- [prometheus-minute-schedule-1,025c4de5702999b3,d039c637a9de4839] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:22.759 INFO 9 --- [ocp-async-3,96833e6c8cd1955a,7fd8c005190a696a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:22.759 WARN 9 --- [ocp-async-5,23a5307899490367,843f80fc3056343b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:24.386 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:24.387 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:24.579 INFO 9 --- [ocp-schedules-13,777bcf0d4b3383e0,d13dbfd8e0ac61e0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:45:24.759 INFO 9 --- [ocp-async-4,19ace940e96eaf2e,02bd0aa58587d474] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:24.759 WARN 9 --- [ocp-async-6,916b85c42b6ba116,d972a13570c2a7ed] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:25.636 INFO 9 --- [prometheus-minute-schedule-1,3a6c8c99c3c612ad,a25625dfbdc9dadc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:25.639 INFO 9 --- [prometheus-minute-schedule-1,3a6c8c99c3c612ad,a25625dfbdc9dadc] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:26.759 INFO 9 --- [ocp-async-1,8ca45f218fc90f25,dac229c0c1937cb1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:26.759 WARN 9 --- [ocp-async-7,f38e2cfade2e61dc,5d44376dc528d270] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:27.387 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:27.387 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:28.636 INFO 9 --- [prometheus-minute-schedule-1,ba066aa9b9c42db3,8c22398f9b009b8c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:28.639 INFO 9 --- [prometheus-minute-schedule-1,ba066aa9b9c42db3,8c22398f9b009b8c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:28.701 INFO 9 --- [ocp-schedules-30,cccfe35e4f1c55e3,d565268266453360] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:45:28.703 INFO 9 --- [ocp-schedules-30,cccfe35e4f1c55e3,d565268266453360] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:45:28.759 INFO 9 --- [ocp-async-2,a2f3c805919f898f,180ce30783cb1733] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:28.759 WARN 9 --- [ocp-async-9,1627f548fd2a7ea4,f3805e05b7ee75dd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:29.452 INFO 9 --- [ocp-schedules-9,1ca998f39266d873,8cc49371958b0c1d] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:45:29.458 WARN 9 --- [scanner-1360643-1,1ca998f39266d873,352273a8dbc72442] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:45:29.938 INFO 9 --- [ocp-schedules-2,c0c06598871561cd,139287d2571af0f4] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:45:29.941 INFO 9 --- [ocp-schedules-11,fb65d798243792c6,3e0ffe3869e1d7bc] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:45:29.941 INFO 9 --- [ocp-schedules-30,9723155b1793d873,66c4470edeb7b91c] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:45:29.942 INFO 9 --- [ocp-schedules-23,1aed95f9a1b16fe6,1a1063630f1d8472] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:45:29.942 INFO 9 --- [ocp-schedules-11,fb65d798243792c6,3e0ffe3869e1d7bc] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:29.942 INFO 9 --- [ocp-schedules-30,9723155b1793d873,66c4470edeb7b91c] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:29.943 INFO 9 --- [ocp-schedules-23,1aed95f9a1b16fe6,1a1063630f1d8472] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:29.943 INFO 9 --- [ocp-schedules-23,1aed95f9a1b16fe6,1a1063630f1d8472] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:45:29.944 INFO 9 --- [ocp-schedules-12,7df7ae465ba3d106,8e480886fb74db86] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:45:29.944 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:45:29.944 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:45:29.944 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:45:29.944 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:45:29.944 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:45:29.944 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:45:29.945 INFO 9 --- [ocp-schedules-10,0052df63a4ba0d7c,a232423b1e606f52] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:45:29.945 INFO 9 --- [host-check-agent-status1,0052df63a4ba0d7c,c2befd37634dbb52] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:45:29.945 INFO 9 --- [host-check-agent-status2,0052df63a4ba0d7c,ed7803c811d7781a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:45:29.945 INFO 9 --- [host-check-agent-status3,0052df63a4ba0d7c,301662c38fee36d5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:45:29.945 INFO 9 --- [host-check-agent-status4,0052df63a4ba0d7c,8a6dc9222b4f08ba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:45:29.945 INFO 9 --- [host-check-agent-status5,0052df63a4ba0d7c,d00d41d325546b4a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:45:29.945 INFO 9 --- [host-check-agent-status6,0052df63a4ba0d7c,a51769d89549b3b4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:45:29.946 INFO 9 --- [ocp-schedules-2,e6b67126be5af549,73838c663d469853] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:45:29.946 INFO 9 --- [host-check-clockdiff1,e6b67126be5af549,078c62f5cd7d76f9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:45:29.946 INFO 9 --- [host-check-clockdiff2,e6b67126be5af549,3b43ac87f8b29c4f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:45:29.946 INFO 9 --- [host-check-clockdiff3,e6b67126be5af549,cfdbefc6ae52b879] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:45:29.946 INFO 9 --- [host-check-clockdiff4,e6b67126be5af549,57b45d4025f3593a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:45:29.946 INFO 9 --- [host-check-clockdiff5,e6b67126be5af549,64041e183bb21dd2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:45:29.946 INFO 9 --- [host-check-clockdiff6,e6b67126be5af549,31a76c7bdacc374c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:45:29.951 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:45:29.952 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:45:29.952 INFO 9 --- [ocp-schedules-8,f4edc9962a6541a0,ec38fcd4a51a8d4e] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:45:29.952 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:29.952 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:45:29.954 INFO 9 --- [host-check-agent-status2,0052df63a4ba0d7c,ed7803c811d7781a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:45:29.954 INFO 9 --- [host-check-agent-status5,0052df63a4ba0d7c,d00d41d325546b4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:45:29.955 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:29.955 INFO 9 --- [host-check-agent-status1,0052df63a4ba0d7c,c2befd37634dbb52] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:45:29.955 INFO 9 --- [host-check-clockdiff3,e6b67126be5af549,cfdbefc6ae52b879] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001529 -1 -1 , error= 2025-09-16 13:45:29.955 INFO 9 --- [host-check-clockdiff4,e6b67126be5af549,57b45d4025f3593a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001529 0 0 , error= 2025-09-16 13:45:29.955 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:45:29.955 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:45:29.955 INFO 9 --- [host-check-clockdiff5,e6b67126be5af549,64041e183bb21dd2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001529 -1 -1 , error= 2025-09-16 13:45:29.955 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:45:29.955 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:45:29.955 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:45:29.955 INFO 9 --- [host-check-agent-status6,0052df63a4ba0d7c,a51769d89549b3b4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:29.955 INFO 9 --- [host-check-agent-status4,0052df63a4ba0d7c,8a6dc9222b4f08ba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:45:29.955 INFO 9 --- [host-check-agent-status3,0052df63a4ba0d7c,301662c38fee36d5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:45:29.956 INFO 9 --- [host-check-agent-status2,0052df63a4ba0d7c,ed7803c811d7781a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:45:29.956 INFO 9 --- [host-check-clockdiff1,e6b67126be5af549,078c62f5cd7d76f9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001529 -1 -1 , error= 2025-09-16 13:45:29.956 INFO 9 --- [host-check-clockdiff2,e6b67126be5af549,3b43ac87f8b29c4f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001529 -1 -1 , error= 2025-09-16 13:45:29.957 INFO 9 --- [host-check-agent-status6,0052df63a4ba0d7c,a51769d89549b3b4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:29.957 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:45:29.957 INFO 9 --- [host-check-agent-status4,0052df63a4ba0d7c,8a6dc9222b4f08ba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:45:29.957 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:45:29.957 INFO 9 --- [host-check-agent-status5,0052df63a4ba0d7c,d00d41d325546b4a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:45:29.957 INFO 9 --- [host-check-agent-status3,0052df63a4ba0d7c,301662c38fee36d5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:45:29.958 INFO 9 --- [host-check-agent-status1,0052df63a4ba0d7c,c2befd37634dbb52] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:45:29.962 INFO 9 --- [ocp-schedules-19,d5f396a78a473986,9f4a190c4c66dfe4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:45:29.963 INFO 9 --- [ocp-schedules-7,624467f4aca51bc6,968a1dbf691aa9dd] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:45:29.967 INFO 9 --- [ocp-schedules-19,d5f396a78a473986,9f4a190c4c66dfe4] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:45:29.970 INFO 9 --- [ocp-schedules-7,624467f4aca51bc6,968a1dbf691aa9dd] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:45:29.970 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:45:29.970 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:45:29.970 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:45:29.971 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:45:29.971 INFO 9 --- [host-check-agent-status3,0052df63a4ba0d7c,301662c38fee36d5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:45:29.971 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:45:29.972 INFO 9 --- [host-check-agent-status4,0052df63a4ba0d7c,8a6dc9222b4f08ba] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:45:29.972 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:45:29.971115232+08:00 2025-09-16 13:45:29.972 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:45:29.971453542+08:00 2025-09-16 13:45:29.972 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:45:29.971507009+08:00 2025-09-16 13:45:29.972 INFO 9 --- [host-check-agent-status5,0052df63a4ba0d7c,d00d41d325546b4a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:45:29.972 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:45:29.973 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:45:29.972+08:00 2025-09-16 13:45:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:29.973 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:45:29.972+08:00 2025-09-16 13:45:29.973 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:45:29.972+08:00 2025-09-16 13:45:29.973 INFO 9 --- [host-check-agent-status2,0052df63a4ba0d7c,ed7803c811d7781a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:45:29.973 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:45:29.971756511+08:00 2025-09-16 13:45:29.973 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:45:29.973+08:00 2025-09-16 13:45:29.973 INFO 9 --- [host-check-agent-status1,0052df63a4ba0d7c,c2befd37634dbb52] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:45:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:45:29.974 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:45:29.973123189+08:00 2025-09-16 13:45:29.974 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:45:29.973001571+08:00 2025-09-16 13:45:29.974 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:45:29.974+08:00 2025-09-16 13:45:29.974 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:45:29.974+08:00 2025-09-16 13:45:29.975 INFO 9 --- [host-check-agent-status6,0052df63a4ba0d7c,a51769d89549b3b4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:45:29.975 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:45:29.972+08:00 and status AVAILABLE 2025-09-16 13:45:29.975 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:45:29.973+08:00 and status AVAILABLE 2025-09-16 13:45:29.975 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:45:29.972+08:00 and status AVAILABLE 2025-09-16 13:45:29.975 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:45:29.972+08:00 and status AVAILABLE 2025-09-16 13:45:29.975 INFO 9 --- [host-check-agent-status4,0052df63a4ba0d7c,8a6dc9222b4f08ba] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:45:29.975 INFO 9 --- [host-check-agent-status4,0052df63a4ba0d7c,8a6dc9222b4f08ba] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:45:29.975 INFO 9 --- [host-check-agent-status4,0052df63a4ba0d7c,8a6dc9222b4f08ba] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:45:29.976 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:45:29.974+08:00 and status AVAILABLE 2025-09-16 13:45:29.976 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:45:29.974+08:00 and status AVAILABLE 2025-09-16 13:45:29.976 INFO 9 --- [host-check-agent-status3,0052df63a4ba0d7c,301662c38fee36d5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:45:29.976 INFO 9 --- [host-check-agent-status3,0052df63a4ba0d7c,301662c38fee36d5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:45:29.976 INFO 9 --- [host-check-agent-status3,0052df63a4ba0d7c,301662c38fee36d5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status5,0052df63a4ba0d7c,d00d41d325546b4a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status5,0052df63a4ba0d7c,d00d41d325546b4a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status5,0052df63a4ba0d7c,d00d41d325546b4a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status1,0052df63a4ba0d7c,c2befd37634dbb52] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status1,0052df63a4ba0d7c,c2befd37634dbb52] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status1,0052df63a4ba0d7c,c2befd37634dbb52] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status2,0052df63a4ba0d7c,ed7803c811d7781a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status2,0052df63a4ba0d7c,ed7803c811d7781a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status2,0052df63a4ba0d7c,ed7803c811d7781a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status6,0052df63a4ba0d7c,a51769d89549b3b4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status6,0052df63a4ba0d7c,a51769d89549b3b4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:45:29.977 INFO 9 --- [host-check-agent-status6,0052df63a4ba0d7c,a51769d89549b3b4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:45:29.978 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:45:29.978 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:45:29.978 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:45:29.978 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:45:29.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:45:29.979 INFO 9 --- [ocp-schedules-30,9723155b1793d873,66c4470edeb7b91c] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:45:29.979 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:45:29.979 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:45:29.984 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:45:29.984 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:45:29.984 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:29.984 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:45:29.985 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:45:29.985 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:45:29.985 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:45:29.985 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:29.985 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:45:29.986 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:45:29.986 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:45:29.986 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:45:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:45:29.998 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:45:29.999 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:45:29.999 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:45:29.999 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:45:29.999 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:45:30.000 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:45:30.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:45:30.002730+08:00, lastProcessTime=2025-09-16T13:45:20.004107+08:00 2025-09-16 13:45:30.026 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:45:30.026 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:45:30.027 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:45:30.027 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:45:30.028 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:30.029 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:45:30.032 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:45:30.033 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:45:30.033 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:45:30.033 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:45:30.034 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:45:30.034 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:45:30.039 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:45:30.039 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:45:30.045 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:30.046 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:30.046 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:30.046 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:30.050 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:30.052 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:45:30.064 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:30.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:30.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:45:30.073 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:45:30.075 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:45:30.076 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:45:30.079 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:45:30.080 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:45:30.080 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:45:30.081 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:45:30.081 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:45:30.084 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:45:30.086 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:45:30.086 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:45:30.088 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:45:30.092 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:30.094 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:30.095 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:30.098 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:30.099 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:30.099 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:30.100 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:45:30.101 INFO 9 --- [prometheus-second-schedule-1,f3f2971842c4aaa0,7c17e9102eea517a] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:45:30.102 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:45:30.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:30.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:30.120 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:45:30.122 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:45:30.123 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:45:30.126 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:45:30.127 INFO 9 --- [host-check-host-status4,7df7ae465ba3d106,2d316e06d73a5f71] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:45:30.127 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:45:30.129 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:45:30.130 INFO 9 --- [host-check-host-status5,7df7ae465ba3d106,da3e2da47e9fbe81] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:45:30.130 INFO 9 --- [host-check-host-status1,7df7ae465ba3d106,0fc49e0ab2e63af6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:45:30.131 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:45:30.002730+08:00 2025-09-16 13:45:30.133 INFO 9 --- [host-check-host-status3,7df7ae465ba3d106,e03d3e472ca50d94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:45:30.134 INFO 9 --- [host-check-host-status2,7df7ae465ba3d106,7c6b594f19dddb6e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:45:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:30.135 INFO 9 --- [host-check-host-status6,7df7ae465ba3d106,5de2dc73e0f78b84] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:45:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:30.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:30.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:30.177 INFO 9 --- [ocp-async-1,77237cfd8eeddf66,adcda42204c82455] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:45:30.191 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.191 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:30.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:30.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.219 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:45:30.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:45:30.245 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:45:30.257 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:30.259 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:30.259 INFO 9 --- [ocp-schedules-3,4c67ce08b9ffd814,e5d3d135fa698f90] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:45:30.260 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:45:30.260 INFO 9 --- [ocp-schedules-3,4c67ce08b9ffd814,e5d3d135fa698f90] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:30.261 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:45:30.261 INFO 9 --- [ocp-schedules-3,4c67ce08b9ffd814,e5d3d135fa698f90] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:45:30.265 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:45:30.268 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:45:30.270 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:30.271 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:30.284 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:45:30.345 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:45:30.357 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:30.359 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:30.359 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:45:30.372 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:45:30.372 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:45:30.373 INFO 9 --- [ocp-schedules-11,fb65d798243792c6,3e0ffe3869e1d7bc] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:45:30.384 INFO 9 --- [ocp-schedules-26,84e99374d07773ee,16c41f4cbe0f2aa0] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:45:30.387 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:30.388 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:30.559 INFO 9 --- [ocp-schedules-23,982256585574132a,2f94b9576fdface6] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:45:30.561 INFO 9 --- [ocp-schedules-23,982256585574132a,2f94b9576fdface6] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:45:30.561 INFO 9 --- [ocp-schedules-23,982256585574132a,2f94b9576fdface6] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:45:30.760 INFO 9 --- [ocp-async-10,62352a3d79d18e16,9d1edf94253ef4d7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:30.760 WARN 9 --- [ocp-async-8,01cf1c04936659e9,b4d197b316f9afbb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:30.809 INFO 9 --- [ocp-schedules-22,f3a16543117e31cf,8aa6f28e7758710e] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:45:30.947 INFO 9 --- [ocp-schedules-17,2e64164b6bcc1c76,8b073a3693caad8d] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:45:30.947 INFO 9 --- [ocp-schedules-17,2e64164b6bcc1c76,8b073a3693caad8d] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:45:31.412 INFO 9 --- [ocp-schedules-28,81d542bbf88b32fd,b95d9d20a4b004a4] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:45:31.412 INFO 9 --- [ocp-schedules-28,81d542bbf88b32fd,b95d9d20a4b004a4] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001531 2025-09-16 13:45:31.412 INFO 9 --- [ocp-schedules-28,81d542bbf88b32fd,b95d9d20a4b004a4] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:45:31.586 INFO 9 --- [ocp-schedules-3,0352420cc498f41b,029e966869653031] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:45:31.636 INFO 9 --- [prometheus-minute-schedule-1,16065aff84e0b7dc,20eac824fe3a364c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:31.638 INFO 9 --- [ocp-schedules-11,d412b85c5761443b,a79564d87add638f] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:45:31.639 INFO 9 --- [prometheus-minute-schedule-1,16065aff84e0b7dc,20eac824fe3a364c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:31.666 INFO 9 --- [ocp-schedules-26,d4c4d800131c9d9e,d5650174704069f8] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:45:31.666 INFO 9 --- [ocp-schedules-26,d4c4d800131c9d9e,d5650174704069f8] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:45:31.666 INFO 9 --- [ocp-schedules-26,d4c4d800131c9d9e,d5650174704069f8] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:45:31.666 INFO 9 --- [ocp-schedules-26,d4c4d800131c9d9e,d5650174704069f8] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:45:31.667 INFO 9 --- [ocp-schedules-26,d4c4d800131c9d9e,d5650174704069f8] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:45:31.667 INFO 9 --- [ocp-schedules-26,d4c4d800131c9d9e,d5650174704069f8] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:45:31.693 INFO 9 --- [ocp-schedules-25,e439bf211a397324,65d68301a7b8811c] c.o.o.s.common.scheduled.PerfSchedules : Collect high risk sql audit stat, time=2025-09-16T13:45:31.693+08:00, tenantSize=3 2025-09-16 13:45:31.697 INFO 9 --- [ocp-schedules-25,e439bf211a397324,65d68301a7b8811c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3currentTimeUs:1758001531693000 2025-09-16 13:45:31.697 INFO 9 --- [ocp-schedules-25,e439bf211a397324,65d68301a7b8811c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3diagnosisStartTimeUs:1758001231670000 2025-09-16 13:45:31.712 INFO 9 --- [ocp-schedules-25,e439bf211a397324,65d68301a7b8811c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3totalLength:0 2025-09-16 13:45:31.718 INFO 9 --- [ocp-schedules-25,e439bf211a397324,65d68301a7b8811c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2currentTimeUs:1758001531715000 2025-09-16 13:45:31.718 INFO 9 --- [ocp-schedules-25,e439bf211a397324,65d68301a7b8811c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2diagnosisStartTimeUs:1758001231639000 2025-09-16 13:45:31.733 INFO 9 --- [ocp-schedules-25,e439bf211a397324,65d68301a7b8811c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2totalLength:0 2025-09-16 13:45:32.467 INFO 9 --- [host-check-clockdiff6,e6b67126be5af549,31a76c7bdacc374c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001532 -1 -1 , error= 2025-09-16 13:45:32.760 INFO 9 --- [ocp-async-1,2c8103dcdbb8b547,d7dda327c6109a60] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:32.760 WARN 9 --- [ocp-async-5,3dc46b6cdf669f7f,93d1b5867619c969] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:33.289 INFO 9 --- [ocp-schedules-30,b5c74b2a9e4bff20,cedcadefda41922a] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:45:33.388 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:33.389 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:33.413 INFO 9 --- [ocp-schedules-24,99c2e0a926ba6b2f,550606b681913f15] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:45:33.413+08:00, clusters=[1] 2025-09-16 13:45:33.414 INFO 9 --- [ocp-schedules-24,99c2e0a926ba6b2f,550606b681913f15] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:45:33.969 INFO 9 --- [ocp-schedules-2,ea813ac33eb25dfc,b4dc598a24c0fd94] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:45:33.969 INFO 9 --- [ocp-schedules-2,ea813ac33eb25dfc,b4dc598a24c0fd94] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:45:33.970 INFO 9 --- [ocp-schedules-2,ea813ac33eb25dfc,b4dc598a24c0fd94] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:45:33.985 INFO 9 --- [ocp-schedules-2,ea813ac33eb25dfc,b4dc598a24c0fd94] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:45:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:45:34.467 INFO 9 --- [ocp-schedules-23,fd9ed2054710fe06,0a7c991163c6e9dd] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:45:34.471 INFO 9 --- [ocp-schedules-23,fd9ed2054710fe06,0a7c991163c6e9dd] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:45:34.471 INFO 9 --- [ocp-schedules-23,fd9ed2054710fe06,0a7c991163c6e9dd] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:45:34.583 INFO 9 --- [ocp-schedules-28,c9f77ac236b18c0e,41925b0640632210] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:45:34.636 INFO 9 --- [prometheus-minute-schedule-1,2dfe3328b121e93f,f1cc6551afec7bdc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:34.639 INFO 9 --- [prometheus-minute-schedule-1,2dfe3328b121e93f,f1cc6551afec7bdc] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:34.760 INFO 9 --- [ocp-async-2,7b01a5278b22e1dd,3d2eff7b4707a672] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:34.760 WARN 9 --- [ocp-async-6,367b8f3f35dbef50,ed3e1e6d36ad221f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:35.441 INFO 9 --- [ocp-schedules-5,c2239290c5f4bd85,da2aa2d3f632af43] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:45:35.441+08:00, clusters=[1] 2025-09-16 13:45:35.445 INFO 9 --- [ocp-schedules-5,c2239290c5f4bd85,da2aa2d3f632af43] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:45:36.389 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:36.390 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:36.760 WARN 9 --- [ocp-async-8,1ddb37bc4bf36b33,4035e97c6b0203f4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:36.760 INFO 9 --- [ocp-async-4,d9da516caf6e8147,1579271eb06d3eab] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:37.485 INFO 9 --- [ocp-schedules-2,e681356989246e3f,a415e47f5d6f709b] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:45:37.487 INFO 9 --- [ocp-schedules-2,e681356989246e3f,a415e47f5d6f709b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:37.509 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:37.510 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:45:37.522 INFO 9 --- [ocp-schedules-2,e681356989246e3f,a415e47f5d6f709b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:45:37.636 INFO 9 --- [prometheus-minute-schedule-1,aab870fa3c826ba0,f7fbf275210a9a2a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:37.639 INFO 9 --- [prometheus-minute-schedule-1,aab870fa3c826ba0,f7fbf275210a9a2a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:38.708 INFO 9 --- [ocp-schedules-27,676443bb108b06e5,965c1091065b5324] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:45:38.710 INFO 9 --- [ocp-schedules-27,676443bb108b06e5,965c1091065b5324] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:45:38.760 WARN 9 --- [ocp-async-10,e1989dcbd25eee64,e6c61b9ccfeb51a5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:38.760 INFO 9 --- [ocp-async-5,6176202b03f46a06,14ea696eef27b7b9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:39.390 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:39.391 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:39.468 INFO 9 --- [ocp-schedules-17,ff6a7cfc5e3ff2b5,6958a7900d45fe2c] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:45:39.468 INFO 9 --- [ocp-schedules-17,ff6a7cfc5e3ff2b5,6958a7900d45fe2c] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:45:39.470 INFO 9 --- [ocp-schedules-20,6db4d6799c116814,867f8882ea860ffc] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:45:39.470 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:45:39.470 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:45:39.470 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:45:39.470 INFO 9 --- [ocp-schedules-20,6db4d6799c116814,867f8882ea860ffc] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:45:39.470 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:45:39.474 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:45:39.474 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:45:39.474 INFO 9 --- [ocp-schedules-20,6db4d6799c116814,867f8882ea860ffc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:45:39.474 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:45:39.474 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:39.475 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:45:39.475 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:45:39.475 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:45:39.475 INFO 9 --- [ocp-schedules-20,6db4d6799c116814,867f8882ea860ffc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:45:39.475 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:39.479 INFO 9 --- [ocp-schedules-10,75289f13794d785e,910e57af7647b793] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:45:39.484 WARN 9 --- [scanner-1360767-1,75289f13794d785e,200c4c1d48f81ae8] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:45:39.485 INFO 9 --- [Collect all tenants major compactions1,ff6a7cfc5e3ff2b5,b9ffd3ec745df8f3] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:45:39.485 INFO 9 --- [Collect all tenants major compactions2,ff6a7cfc5e3ff2b5,e1014e3798fb2f63] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:45:39.485 INFO 9 --- [Collect all tenants major compactions3,ff6a7cfc5e3ff2b5,b7d470fd6d251a8d] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:45:39.495 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:45:39.496 INFO 9 --- [ocp-schedules-20,6db4d6799c116814,867f8882ea860ffc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:45:39.496 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:45:39.497 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:45:39.497 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:45:39.497 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:45:39.498 INFO 9 --- [alarm-detect-18,75289f13794d785e,89ddc3398de17d1b] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:45:39.501 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:45:39.501 INFO 9 --- [alarm-detect-6,75289f13794d785e,4d266d3af176a506] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:45:39.502 INFO 9 --- [alarm-detect-1,75289f13794d785e,a690aa51b7c95446] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:45:39.502 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:45:39.508 INFO 9 --- [Collect all tenants major compactions1,ff6a7cfc5e3ff2b5,b9ffd3ec745df8f3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:39.508 INFO 9 --- [Collect all tenants major compactions2,ff6a7cfc5e3ff2b5,e1014e3798fb2f63] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:39.509 INFO 9 --- [Collect all tenants major compactions3,ff6a7cfc5e3ff2b5,b7d470fd6d251a8d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:39.510 INFO 9 --- [Collect all tenants major compactions1,ff6a7cfc5e3ff2b5,b9ffd3ec745df8f3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:45:39.510 INFO 9 --- [Collect all tenants major compactions2,ff6a7cfc5e3ff2b5,e1014e3798fb2f63] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:45:39.511 INFO 9 --- [Collect all tenants major compactions3,ff6a7cfc5e3ff2b5,b7d470fd6d251a8d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:45:39.514 INFO 9 --- [alarm-detect-1,75289f13794d785e,c1464f5a66dd4377] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:45:39.515 INFO 9 --- [Collect all tenants major compactions1,ff6a7cfc5e3ff2b5,b9ffd3ec745df8f3] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:45:39.516 INFO 9 --- [Collect all tenants major compactions3,ff6a7cfc5e3ff2b5,b7d470fd6d251a8d] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:45:39.516 INFO 9 --- [Collect all tenants major compactions2,ff6a7cfc5e3ff2b5,e1014e3798fb2f63] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:45:39.516 INFO 9 --- [ocp-schedules-17,ff6a7cfc5e3ff2b5,6958a7900d45fe2c] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:45:39.518 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:45:39.519 INFO 9 --- [ocp-schedules-20,6db4d6799c116814,867f8882ea860ffc] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:45:40.002 INFO 9 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:45:40.002 INFO 9 --- [ocp-schedules-27,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:45:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:45:40.003602+08:00, lastProcessTime=2025-09-16T13:45:30.002730+08:00 2025-09-16 13:45:40.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:45:40.003602+08:00 2025-09-16 13:45:40.177 INFO 9 --- [ocp-async-7,48b98747cbe9e364,3b506e1c1828e1b2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:45:40.399 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:41:40.35, end=2025-09-16T13:43:40.397} 2025-09-16 13:45:40.402 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false 2025-09-16 13:45:40.402 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:45:40.404 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:41:40.35, end=2025-09-16T13:43:40.397},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:45:40.404 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:45:40.404 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:45:40.409 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:45:40.411 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 1 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:41:40.35, end=2025-09-16T13:43:40.397},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:45:40.417 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:45:40.417 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:45:40.464 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915140464000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=059C3EF76E9644CCC465E3910B3A28F8, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:45:40.464Z, endTime=2025-09-16T05:43:40.397Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:45:40.464 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915140464000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=5ED4343A562E144150DFDAC006BC3F7A, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:45:40.464Z, endTime=2025-09-16T05:43:40.397Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:45:40.465 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915140465000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=E9E2014C8CE705871C555597A6A32456, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:45:40.465Z, endTime=2025-09-16T05:43:40.397Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:45:40.466 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915140466000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=AD4C944303CA293377EAC9EF82D349E6, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:45:40.466Z, endTime=2025-09-16T05:43:40.397Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:45:40.468 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915140468000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:45:40.468Z, endTime=2025-09-16T05:43:40.397Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:45:40.471 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 0 2025-09-16 13:45:40.471 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:45:40.472 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 36 2025-09-16 13:45:40.472 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:45:40.472 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 0 2025-09-16 13:45:40.473 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:45:40.473 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 1 2025-09-16 13:45:40.473 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:45:40.475 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 34 2025-09-16 13:45:40.475 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:45:40.487 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.487 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=AD4C944303CA293377EAC9EF82D349E6, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.487 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.487 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=059C3EF76E9644CCC465E3910B3A28F8, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.487 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.487 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=5ED4343A562E144150DFDAC006BC3F7A, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.488 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.488 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.489 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.489 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.493 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:45:40.494 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:45:40.494 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:45:40.494 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:45:40.494 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:45:40.494 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:45:40.494 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:45:40.494 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:45:40.496 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:45:40.496 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:45:40.508 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.508 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.508 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=AD4C944303CA293377EAC9EF82D349E6, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.508 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=059C3EF76E9644CCC465E3910B3A28F8, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.509 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.509 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=5ED4343A562E144150DFDAC006BC3F7A, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.509 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.509 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.511 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:45:40.511 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001420397000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 13:45:40.515 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records,use plan union hash 2025-09-16 13:45:40.515 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 0 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:45:40.466, end=2025-09-16T13:43:40.397}, clusterId=1, tenantId=3, sqlId=AD4C944303CA293377EAC9EF82D349E6, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:45:40.515 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 13:45:40.515 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records,use plan union hash 2025-09-16 13:45:40.515 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 0 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:45:40.465, end=2025-09-16T13:43:40.397}, clusterId=1, tenantId=3, sqlId=E9E2014C8CE705871C555597A6A32456, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:45:40.515 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 1 records,use plan union hash 2025-09-16 13:45:40.518 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 13:45:40.527 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:45:40.464, end=2025-09-16T13:43:40.397}, clusterId=1, tenantId=3, sqlId=5ED4343A562E144150DFDAC006BC3F7A, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:45:40.538 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:45:40.464, end=2025-09-16T13:43:40.397}, clusterId=1, tenantId=3, sqlId=059C3EF76E9644CCC465E3910B3A28F8, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:45:40.542 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:45:40.468, end=2025-09-16T13:43:40.397}, clusterId=1, tenantId=3, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:45:40.542 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:45:40.548 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:41:40.35, end=2025-09-16T13:43:40.397},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:45:40.548 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:45:40.548 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:45:40.558 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:45:40.636 INFO 9 --- [prometheus-minute-schedule-1,bde312c21c367f4c,0bf586d2040ebb57] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:40.639 INFO 9 --- [prometheus-minute-schedule-1,bde312c21c367f4c,0bf586d2040ebb57] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:40.760 WARN 9 --- [ocp-async-3,712a4405413cc043,b7250c901514451b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:40.760 INFO 9 --- [ocp-async-2,26b2c0cc90137b5c,69cc720ea5dc89ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:41.506 INFO 9 --- [ocp-schedules-13,86ce158f2295272d,fd8b065e4b9fdd90] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:45:41.507 INFO 9 --- [ocp-schedules-13,86ce158f2295272d,fd8b065e4b9fdd90] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:41.551 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:45:41.551 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.553 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:45:41.576 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.576 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:45:41.599 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.599 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:45:41.623 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.623 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:45:41.628 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.628 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:45:41.652 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.653 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:45:41.676 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.677 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:45:41.682 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.682 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:45:41.706 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.706 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:45:41.730 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.730 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:45:41.749 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.750 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:45:41.751 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.752 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:45:41.753 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.754 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:45:41.754 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.755 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:45:41.756 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.757 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:45:41.757 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.758 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:45:41.775 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.776 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:45:41.776 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.777 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:45:41.778 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.779 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:45:41.794 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:45:41.796 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:45:41.822 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:45:41.823 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.824 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:45:41.842 INFO 9 --- [ocp-schedules-7,fe2e579f2455d4d2,9abe64ca7ba821b9] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:45:41.842 INFO 9 --- [ocp-schedules-7,fe2e579f2455d4d2,9abe64ca7ba821b9] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:45:41.856 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:45:41.856 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:45:41.856 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:45:41.856 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:45:41.856 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:45:41.856 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:45:41.858 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:45:41.858 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:45:41.858 INFO 9 --- [ocp-schedules-13,86ce158f2295272d,fd8b065e4b9fdd90] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:45:41.879 INFO 9 --- [ocp-schedules-7,fe2e579f2455d4d2,9abe64ca7ba821b9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:41.880 INFO 9 --- [ocp-schedules-7,fe2e579f2455d4d2,9abe64ca7ba821b9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:45:42.391 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:42.392 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:42.760 WARN 9 --- [ocp-async-7,cd2c0d3c947de0ab,eb6f4b4e20c1ed40] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:42.760 INFO 9 --- [ocp-async-4,20ad689bc0166415,b22f618522eabdf0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:45:42,888 |-INFO in ReconfigureOnChangeTask(born:1758001422888) - Empty watch file list. Disabling 2025-09-16 13:45:43.636 INFO 9 --- [prometheus-minute-schedule-1,d1ef68535fc616ae,c3ea66355a3cf54d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:43.639 INFO 9 --- [prometheus-minute-schedule-1,d1ef68535fc616ae,c3ea66355a3cf54d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:44.143 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,c322e23ae175767d,b99bab999375de80] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=c322e23ae175767d, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:45:44.143 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,c322e23ae175767d,b99bab999375de80] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=c322e23ae175767d, duration=0 ms] 2025-09-16 13:45:44.587 INFO 9 --- [ocp-schedules-12,2c21240218f56e9f,5e9db64de09620c7] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:45:44.760 WARN 9 --- [ocp-async-10,d7cabbac36efc188,9c3331f59821d399] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:44.760 INFO 9 --- [ocp-async-5,d2529889c40700b4,374007c2d0955dcc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:45.392 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:45.392 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:46.636 INFO 9 --- [prometheus-minute-schedule-1,84ee09d01840c42e,ad454917e5110f81] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:46.639 INFO 9 --- [prometheus-minute-schedule-1,84ee09d01840c42e,ad454917e5110f81] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:46.760 INFO 9 --- [ocp-async-6,ff50f73a0e099adf,a36d5fe79cd6f357] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:46.761 WARN 9 --- [ocp-async-8,f2fff0a69807e0d5,69cd65202a23cba7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:48.392 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:48.393 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:48.714 INFO 9 --- [ocp-schedules-11,9da1614c2ada4b29,62a6534034ea72ce] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:45:48.716 INFO 9 --- [ocp-schedules-11,9da1614c2ada4b29,62a6534034ea72ce] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:45:48.761 INFO 9 --- [ocp-async-2,c1679b6aee383072,ea70163d48796607] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:48.761 WARN 9 --- [ocp-async-9,527ed477302fd3b7,5f5c703361e7bd9a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:49.517 INFO 9 --- [ocp-schedules-13,b8270bc2dc2ee309,7f5fd5b044dd0f5d] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:45:49.523 WARN 9 --- [scanner-1360931-1,b8270bc2dc2ee309,7308520c37a6c8f1] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:45:49.636 INFO 9 --- [prometheus-minute-schedule-1,a218fa0488995563,8574f80076ee1e54] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:49.639 INFO 9 --- [prometheus-minute-schedule-1,a218fa0488995563,8574f80076ee1e54] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:45:50.003635+08:00, lastProcessTime=2025-09-16T13:45:40.003602+08:00 2025-09-16 13:45:50.115 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:45:50.003635+08:00 2025-09-16 13:45:50.177 INFO 9 --- [ocp-async-8,d0ec37463b6d4888,6e4528af6ab00331] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:45:50.761 INFO 9 --- [ocp-async-10,f45ce098610f153e,3b1da6ece71b8a9d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:50.761 WARN 9 --- [ocp-async-5,2c3fd28d28e54729,7576e817b4662b85] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:51.393 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:51.394 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:52.636 INFO 9 --- [prometheus-minute-schedule-1,0d7fca95142918a4,59ae97f7fab84cd5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:52.639 INFO 9 --- [prometheus-minute-schedule-1,0d7fca95142918a4,59ae97f7fab84cd5] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:52.761 INFO 9 --- [ocp-async-8,937d6aeb63e21374,ff0c15cb32d60c2a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:52.761 WARN 9 --- [ocp-async-6,2bd09c2325de429f,c40a57ef82231c87] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:54.394 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:54.395 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:54.473 INFO 9 --- [ocp-schedules-4,a4bf5e12289463e1,940e581f6b353cb1] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:45:54.478 INFO 9 --- [ocp-schedules-4,a4bf5e12289463e1,940e581f6b353cb1] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:45:54.478 INFO 9 --- [ocp-schedules-4,a4bf5e12289463e1,940e581f6b353cb1] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:45:54.591 INFO 9 --- [ocp-schedules-9,e0ddac457c365644,32892b66c872b5f0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:45:54.761 INFO 9 --- [ocp-async-9,33b9a39e3ccadbb8,ef6e57e41832955e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:54.761 WARN 9 --- [ocp-async-2,9f80754493901bca,768067d708abde90] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:55.636 INFO 9 --- [prometheus-minute-schedule-1,94ec24012521eb07,636c7d5663538fd4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:55.639 INFO 9 --- [prometheus-minute-schedule-1,94ec24012521eb07,636c7d5663538fd4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:56.761 INFO 9 --- [ocp-async-4,f6f966472dcb5774,7d40ef7ce22c150b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:56.761 WARN 9 --- [ocp-async-1,169306e8908c3a8d,2538382c433864fd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:57.395 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:45:57.396 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:45:58.636 INFO 9 --- [prometheus-minute-schedule-1,fac3b7aa3cd8d8ef,a201836b7abb5aa6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001560, interval=60 2025-09-16 13:45:58.639 INFO 9 --- [prometheus-minute-schedule-1,fac3b7aa3cd8d8ef,a201836b7abb5aa6] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:45:58.721 INFO 9 --- [ocp-schedules-4,bfdb4a8abb8f7989,dfdbf2c35661127c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:45:58.723 INFO 9 --- [ocp-schedules-4,bfdb4a8abb8f7989,dfdbf2c35661127c] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:45:58.761 WARN 9 --- [ocp-async-3,af6fe68e763c0c62,0790e6dd3fa6184a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:45:58.761 INFO 9 --- [ocp-async-6,8472abaa7c29ebb6,cb31010eb53a6cbb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:45:59.546 INFO 9 --- [ocp-schedules-28,6487896e2c6992d8,45a000377ac4209f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:45:59.551 WARN 9 --- [scanner-1361058-1,6487896e2c6992d8,0807975a28451156] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:45:59.562 INFO 9 --- [alarm-detect-7,6487896e2c6992d8,0ad7cc46eedd04c7] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:45:59.563 INFO 9 --- [alarm-detect-10,6487896e2c6992d8,4982d5cdcf7ab1d5] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:45:59.564 INFO 9 --- [alarm-detect-3,6487896e2c6992d8,a48d41d0d3fd2fe5] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:45:59.576 INFO 9 --- [alarm-detect-20,6487896e2c6992d8,232a65eb870209ce] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:45:59.938 INFO 9 --- [ocp-schedules-21,3bbd99317e760a91,7ec64631efc55469] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:45:59.941 INFO 9 --- [ocp-schedules-3,23753f4eca5d0fe6,79d870e055f3138f] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:45:59.941 INFO 9 --- [ocp-schedules-6,5e934eb5aa621f8b,db3505735925d640] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:45:59.942 INFO 9 --- [ocp-schedules-8,428d20048a31ab00,4ef093ef0969282b] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:45:59.942 INFO 9 --- [ocp-schedules-3,23753f4eca5d0fe6,79d870e055f3138f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:59.943 INFO 9 --- [ocp-schedules-6,5e934eb5aa621f8b,db3505735925d640] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:59.943 INFO 9 --- [ocp-schedules-8,428d20048a31ab00,4ef093ef0969282b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:45:59.944 INFO 9 --- [ocp-schedules-8,428d20048a31ab00,4ef093ef0969282b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:45:59.944 INFO 9 --- [ocp-schedules-5,af83f9e6085f7370,7c4e65f5570ea48c] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:45:59.944 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:45:59.944 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:45:59.944 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:45:59.944 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:45:59.944 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:45:59.944 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:45:59.945 INFO 9 --- [ocp-schedules-21,58916d1efc7323d1,eccfc34a5b8bc2e5] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:45:59.945 INFO 9 --- [ocp-schedules-1,401dc943b6190334,ddd647f3ed794e29] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:45:59.945 INFO 9 --- [host-check-clockdiff1,58916d1efc7323d1,a791e85c53acf781] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:45:59.945 INFO 9 --- [host-check-clockdiff2,58916d1efc7323d1,a83d5295d1c94c9d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:45:59.945 INFO 9 --- [host-check-agent-status1,401dc943b6190334,5d9625aaaa04ac00] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:45:59.945 INFO 9 --- [host-check-clockdiff3,58916d1efc7323d1,1cf5adf512aae79a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:45:59.945 INFO 9 --- [host-check-clockdiff4,58916d1efc7323d1,7ba406054da31a28] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:45:59.945 INFO 9 --- [host-check-agent-status2,401dc943b6190334,e8ee8f230a1c193a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:45:59.946 INFO 9 --- [host-check-clockdiff5,58916d1efc7323d1,3056f2809c864554] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:45:59.946 INFO 9 --- [host-check-agent-status3,401dc943b6190334,da8fd6306d3d4dfd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:45:59.946 INFO 9 --- [host-check-clockdiff6,58916d1efc7323d1,c1000d62e88ae8e3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:45:59.946 INFO 9 --- [host-check-agent-status4,401dc943b6190334,7b359b5892f98c91] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:45:59.946 INFO 9 --- [host-check-agent-status5,401dc943b6190334,8399887adfd52812] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:45:59.946 INFO 9 --- [host-check-agent-status6,401dc943b6190334,6e3c6542a556a673] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:45:59.947 INFO 9 --- [ocp-schedules-9,6f447c362efbb501,506e6003be746bac] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:45:59.950 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:59.950 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:45:59.950 INFO 9 --- [host-check-clockdiff4,58916d1efc7323d1,7ba406054da31a28] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001559 -1 -1 , error= 2025-09-16 13:45:59.950 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:45:59.950 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:45:59.953 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:45:59.953 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:45:59.955 INFO 9 --- [host-check-clockdiff3,58916d1efc7323d1,1cf5adf512aae79a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001559 -1 -1 , error= 2025-09-16 13:45:59.955 INFO 9 --- [host-check-clockdiff5,58916d1efc7323d1,3056f2809c864554] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001559 -1 -1 , error= 2025-09-16 13:45:59.955 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:59.957 INFO 9 --- [host-check-agent-status4,401dc943b6190334,7b359b5892f98c91] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:45:59.957 INFO 9 --- [host-check-agent-status3,401dc943b6190334,da8fd6306d3d4dfd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:45:59.957 INFO 9 --- [host-check-agent-status6,401dc943b6190334,6e3c6542a556a673] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:59.957 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:45:59.957 INFO 9 --- [host-check-agent-status2,401dc943b6190334,e8ee8f230a1c193a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:45:59.957 INFO 9 --- [host-check-clockdiff6,58916d1efc7323d1,c1000d62e88ae8e3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001559 -1 -1 , error= 2025-09-16 13:45:59.958 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:45:59.958 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:45:59.958 INFO 9 --- [host-check-agent-status5,401dc943b6190334,8399887adfd52812] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:45:59.958 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:45:59.958 INFO 9 --- [host-check-agent-status1,401dc943b6190334,5d9625aaaa04ac00] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:45:59.959 INFO 9 --- [host-check-agent-status4,401dc943b6190334,7b359b5892f98c91] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:45:59.959 INFO 9 --- [host-check-agent-status2,401dc943b6190334,e8ee8f230a1c193a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:45:59.959 INFO 9 --- [host-check-agent-status3,401dc943b6190334,da8fd6306d3d4dfd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:45:59.959 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:45:59.959 INFO 9 --- [host-check-agent-status5,401dc943b6190334,8399887adfd52812] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:45:59.959 INFO 9 --- [host-check-agent-status1,401dc943b6190334,5d9625aaaa04ac00] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:45:59.959 INFO 9 --- [host-check-agent-status6,401dc943b6190334,6e3c6542a556a673] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:59.973 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:45:59.973 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:45:59.973 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:45:59.973 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:45:59.974 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:45:59.974 INFO 9 --- [host-check-agent-status1,401dc943b6190334,5d9625aaaa04ac00] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:45:59.974 INFO 9 --- [host-check-agent-status3,401dc943b6190334,da8fd6306d3d4dfd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:45:59.974 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:45:59.974 INFO 9 --- [host-check-agent-status4,401dc943b6190334,7b359b5892f98c91] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:45:59.974 INFO 9 --- [host-check-agent-status6,401dc943b6190334,6e3c6542a556a673] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:45:59.973917679+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:45:59.973981053+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:45:59.973925659+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:45:59.973839199+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-agent-status2,401dc943b6190334,e8ee8f230a1c193a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:45:59.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:45:59.974676325+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:45:59.975+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:45:59.975+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:45:59.975+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:45:59.975+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:45:59.974863328+08:00 2025-09-16 13:45:59.975 INFO 9 --- [host-check-agent-status5,401dc943b6190334,8399887adfd52812] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:45:59.976 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:45:59.975+08:00 2025-09-16 13:45:59.976 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:45:59.975+08:00 2025-09-16 13:45:59.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:45:59.977 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:45:59.975+08:00 and status AVAILABLE 2025-09-16 13:45:59.977 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:45:59.975+08:00 and status AVAILABLE 2025-09-16 13:45:59.977 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:45:59.975+08:00 and status AVAILABLE 2025-09-16 13:45:59.977 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:45:59.975+08:00 and status AVAILABLE 2025-09-16 13:45:59.977 INFO 9 --- [host-check-agent-status1,401dc943b6190334,5d9625aaaa04ac00] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:45:59.977 INFO 9 --- [host-check-agent-status1,401dc943b6190334,5d9625aaaa04ac00] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:45:59.977 INFO 9 --- [host-check-agent-status1,401dc943b6190334,5d9625aaaa04ac00] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:45:59.977 INFO 9 --- [host-check-agent-status4,401dc943b6190334,7b359b5892f98c91] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:45:59.977 INFO 9 --- [host-check-agent-status4,401dc943b6190334,7b359b5892f98c91] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:45:59.977 INFO 9 --- [host-check-agent-status4,401dc943b6190334,7b359b5892f98c91] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:45:59.978 INFO 9 --- [host-check-agent-status3,401dc943b6190334,da8fd6306d3d4dfd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:45:59.978 INFO 9 --- [host-check-agent-status3,401dc943b6190334,da8fd6306d3d4dfd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:45:59.978 INFO 9 --- [host-check-agent-status3,401dc943b6190334,da8fd6306d3d4dfd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:45:59.978 INFO 9 --- [host-check-agent-status2,401dc943b6190334,e8ee8f230a1c193a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:45:59.978 INFO 9 --- [host-check-agent-status2,401dc943b6190334,e8ee8f230a1c193a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:45:59.978 INFO 9 --- [host-check-agent-status2,401dc943b6190334,e8ee8f230a1c193a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:45:59.978 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:45:59.975+08:00 and status AVAILABLE 2025-09-16 13:45:59.978 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:45:59.975+08:00 and status AVAILABLE 2025-09-16 13:45:59.979 INFO 9 --- [host-check-agent-status5,401dc943b6190334,8399887adfd52812] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:45:59.979 INFO 9 --- [host-check-agent-status5,401dc943b6190334,8399887adfd52812] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:45:59.979 INFO 9 --- [host-check-agent-status5,401dc943b6190334,8399887adfd52812] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:45:59.979 INFO 9 --- [host-check-agent-status6,401dc943b6190334,6e3c6542a556a673] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:45:59.979 INFO 9 --- [host-check-agent-status6,401dc943b6190334,6e3c6542a556a673] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:45:59.980 INFO 9 --- [host-check-agent-status6,401dc943b6190334,6e3c6542a556a673] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:45:59.980 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:45:59.980 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:45:59.980 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:45:59.981 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:45:59.981 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:45:59.981 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:45:59.982 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:45:59.982 INFO 9 --- [ocp-schedules-6,5e934eb5aa621f8b,db3505735925d640] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:45:59.985 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:45:59.986 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:45:59.986 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:45:59.986 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:45:59.987 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:45:59.987 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:45:59.987 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:45:59.988 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:45:59.988 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:45:59.988 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:45:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:45:59.988 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:45:59.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:45:59.989 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:45:59.999 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:00.000 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:00.001 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:00.002 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:00.003 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:00.003 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:00.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:46:00.005267+08:00, lastProcessTime=2025-09-16T13:45:50.003635+08:00 2025-09-16 13:46:00.027 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:46:00.028 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:00.029 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:46:00.029 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:46:00.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:00.030 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:46:00.031 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:46:00.031 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:46:00.033 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:46:00.034 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:46:00.036 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:46:00.036 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:46:00.037 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:46:00.038 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:46:00.039 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:46:00.048 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:00.050 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:00.050 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:00.050 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:00.051 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:00.051 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:00.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:00.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:00.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:46:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:00.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:46:00.075 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:00.076 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:46:00.077 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:46:00.078 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:46:00.079 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:46:00.080 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:46:00.083 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:46:00.083 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:46:00.085 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:46:00.086 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:46:00.086 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:46:00.087 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:46:00.090 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:46:00.090 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.090 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:00.095 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:00.096 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:00.097 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:00.099 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:00.099 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:00.100 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:00.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:00.121 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.121 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:00.123 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:46:00.124 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:46:00.125 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:46:00.127 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:46:00.127 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:46:00.128 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:46:00.130 INFO 9 --- [host-check-host-status5,af83f9e6085f7370,e1459bcfaeabe652] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:46:00.131 INFO 9 --- [host-check-host-status6,af83f9e6085f7370,0c9965b620b54692] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:46:00.133 INFO 9 --- [host-check-host-status2,af83f9e6085f7370,536c9c563f97fd94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:46:00.133 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:46:00.005267+08:00 2025-09-16 13:46:00.133 INFO 9 --- [host-check-host-status1,af83f9e6085f7370,2d9de54246efe0c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:46:00.134 INFO 9 --- [host-check-host-status3,af83f9e6085f7370,ab98f611b258da85] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:46:00.135 INFO 9 --- [host-check-host-status4,af83f9e6085f7370,ce14fc054e9d0ed5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:46:00.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:00.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:00.167 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.167 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:00.177 INFO 9 --- [ocp-async-1,de724efe4b2adc6d,f1b721af3f9550a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:46:00.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:00.196 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.196 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:00.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:00.223 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:00.237 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:00.238 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:00.239 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:46:00.244 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:46:00.247 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:46:00.250 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:00.251 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:00.263 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:46:00.325 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:46:00.339 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:00.341 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:00.341 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:46:00.355 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:46:00.355 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:46:00.355 INFO 9 --- [ocp-schedules-3,23753f4eca5d0fe6,79d870e055f3138f] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:46:00.396 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:00.396 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:00.761 WARN 9 --- [ocp-async-9,c864da7f08090203,ce72e3c4eada69c1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:00.761 INFO 9 --- [ocp-async-2,c2591ef0b1a37aa8,63ba8644bfea16f9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:00.811 INFO 9 --- [ocp-schedules-20,b635cfbbf637262e,4a7f41f1fd58ed4f] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:46:00.889 INFO 9 --- [host-check-clockdiff2,58916d1efc7323d1,a83d5295d1c94c9d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001560 -2 -2 , error= 2025-09-16 13:46:00.889 INFO 9 --- [host-check-clockdiff1,58916d1efc7323d1,a791e85c53acf781] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001560 -1 -1 , error= 2025-09-16 13:46:01.636 INFO 9 --- [prometheus-minute-schedule-1,13b258f51e7a37f2,9585f722062a081b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:01.639 INFO 9 --- [prometheus-minute-schedule-1,13b258f51e7a37f2,9585f722062a081b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:02.761 INFO 9 --- [ocp-async-5,d9cf63b590be2cba,b44f6b921ea4048a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:02.761 WARN 9 --- [ocp-async-4,468da93a47ddb890,e3f8f064d2443f2a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:03.396 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:03.397 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:04.594 INFO 9 --- [ocp-schedules-15,bbe330d7e6d16852,3bf3c2fd62357e92] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:46:04.636 INFO 9 --- [prometheus-minute-schedule-1,4eb8291ca92176fd,389e991c2457de36] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:04.639 INFO 9 --- [prometheus-minute-schedule-1,4eb8291ca92176fd,389e991c2457de36] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:04.762 WARN 9 --- [ocp-async-6,5c14e8f2789eac6d,2f9988f293734ba6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:04.762 INFO 9 --- [ocp-async-10,411e138065f7f178,25a46328f6862ea2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:06.397 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:06.398 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:06.762 WARN 9 --- [ocp-async-7,2cdb6219002fb952,49d1d1b09583e964] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:06.762 INFO 9 --- [ocp-async-9,d5ae80f02e74a09c,4f6f7893ff3e4e4c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:07.636 INFO 9 --- [prometheus-minute-schedule-1,fb85dc4bd94e2e9d,2c0177d89f25e127] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:07.639 INFO 9 --- [prometheus-minute-schedule-1,fb85dc4bd94e2e9d,2c0177d89f25e127] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:08.727 INFO 9 --- [ocp-schedules-1,cdc99caa36eb4311,8485163f168d3563] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:46:08.729 INFO 9 --- [ocp-schedules-1,cdc99caa36eb4311,8485163f168d3563] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:46:08.762 INFO 9 --- [ocp-async-4,da82f7a43a5945cc,5587e208bc511d55] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:08.762 WARN 9 --- [ocp-async-1,95d052daa01cc607,8f3148106eec0029] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:09.398 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:09.399 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:09.579 INFO 9 --- [ocp-schedules-11,64c6aeaf273db74b,48d30287e3930a21] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:46:09.583 WARN 9 --- [scanner-1361230-1,64c6aeaf273db74b,56f659b88b9b5485] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:46:10.002 INFO 9 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:46:10.002 INFO 9 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:46:10.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:46:10.005211+08:00, lastProcessTime=2025-09-16T13:46:00.005267+08:00 2025-09-16 13:46:10.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:46:10.005211+08:00 2025-09-16 13:46:10.177 INFO 9 --- [ocp-async-7,fa24545c7d68593a,8bf7cc32ec496b57] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:46:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:46:10.636 INFO 9 --- [prometheus-minute-schedule-1,f8851e7a2f192091,61221500bb00c61c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:10.639 INFO 9 --- [prometheus-minute-schedule-1,f8851e7a2f192091,61221500bb00c61c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:10.762 WARN 9 --- [ocp-async-10,ab6a78890349db63,71b3f1b8afe1735f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:10.762 INFO 9 --- [ocp-async-3,491f9d762d45da47,5addca3fb4919d51] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:11.692 INFO 9 --- [metric-archive-async-1,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001500, nodeCount=460, affectRows=460 2025-09-16 13:46:12.399 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:12.400 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:12.762 WARN 9 --- [ocp-async-9,541c3e37f2843176,74b20f630592a948] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:12.762 INFO 9 --- [ocp-async-8,bbe1eac425141053,e31c8b1458444aec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:13.570 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001500, nodeCount=1000, affectRows=1000 2025-09-16 13:46:13.572 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001500, nodeCount=1000, validCount=996 2025-09-16 13:46:13.598 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001500, nodeCount=1000, affectRows=1000 2025-09-16 13:46:13.600 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001500, nodeCount=1000, validCount=998 2025-09-16 13:46:13.611 ERROR 9 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221684167) Duplicate entry '824401952595427328-1758001440' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221684167) Duplicate entry '824401952595427328-1758001440' for key 'PRIMARY' 2025-09-16 13:46:13.636 INFO 9 --- [prometheus-minute-schedule-1,0b45ef2192041ce7,35cf07dab4b53c63] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:13.640 INFO 9 --- [prometheus-minute-schedule-1,0b45ef2192041ce7,35cf07dab4b53c63] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:14.479 INFO 9 --- [ocp-schedules-10,bffc84a684517a09,869d69b0417733f0] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:46:14.483 INFO 9 --- [ocp-schedules-10,bffc84a684517a09,869d69b0417733f0] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:46:14.483 INFO 9 --- [ocp-schedules-10,bffc84a684517a09,869d69b0417733f0] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:46:14.598 INFO 9 --- [ocp-schedules-6,26c6067e6e7a04d2,9a9d61b4f2bbc1b6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:46:14.762 WARN 9 --- [ocp-async-4,b288e1d0606e592f,e426a28d7e008e88] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:14.762 INFO 9 --- [ocp-async-2,7b7c24cc5a22cf77,36651dc30e3cab73] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:14.908 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001500, nodeCount=1000, affectRows=1000 2025-09-16 13:46:14.911 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001500, nodeCount=992, validCount=946 2025-09-16 13:46:14.935 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001500, nodeCount=853, affectRows=853 2025-09-16 13:46:14.937 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001500, nodeCount=853, validCount=851 2025-09-16 13:46:15.400 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:15.401 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:16.636 INFO 9 --- [prometheus-minute-schedule-1,72c5c48f468526f4,1a735dfb38ffd433] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:16.639 INFO 9 --- [prometheus-minute-schedule-1,72c5c48f468526f4,1a735dfb38ffd433] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:16.762 INFO 9 --- [ocp-async-10,1382a738782834c9,87bae775d37c0ae6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:16.762 WARN 9 --- [ocp-async-6,ad01ffda0fd9921e,824369fbddd3f670] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:18.401 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:18.402 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:18.733 INFO 9 --- [ocp-schedules-12,8ebf48dae4abfb21,ea7400bbe7371fdc] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:46:18.735 INFO 9 --- [ocp-schedules-12,8ebf48dae4abfb21,ea7400bbe7371fdc] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:46:18.762 INFO 9 --- [ocp-async-9,e0d90441f4074e43,1f4804e5e81e0085] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:18.762 WARN 9 --- [ocp-async-7,1f44f6355f45f521,8514bc59a4c3dc1a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:19.604 INFO 9 --- [ocp-schedules-22,c30df0ef789ecc08,a2257dadd815d366] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:46:19.609 WARN 9 --- [scanner-1362224-1,c30df0ef789ecc08,ef4f880bd2d5c0cc] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:46:19.620 INFO 9 --- [alarm-detect-9,c30df0ef789ecc08,0a166241e34a6281] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:46:19.621 INFO 9 --- [alarm-detect-6,c30df0ef789ecc08,0ad733c2ca12cf22] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:46:19.621 INFO 9 --- [alarm-detect-3,c30df0ef789ecc08,7a5f0c170b8091f0] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:46:19.634 INFO 9 --- [alarm-detect-1,c30df0ef789ecc08,943e7d10864743fc] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:46:19.636 INFO 9 --- [prometheus-minute-schedule-1,9c77e8098207db0c,a845b5a7f93e82cf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:19.639 INFO 9 --- [prometheus-minute-schedule-1,9c77e8098207db0c,a845b5a7f93e82cf] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:20.008 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:46:20.007989+08:00, lastProcessTime=2025-09-16T13:46:10.005211+08:00 2025-09-16 13:46:20.122 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:46:20.007989+08:00 2025-09-16 13:46:20.177 INFO 9 --- [ocp-async-6,d7b0091245111323,ef5c4d6dd65f39a0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:46:20.636 INFO 9 --- [prometheus-cache-monitor1,9478d94883de1b45,ee28b0342410a54e] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:46:20.636 INFO 9 --- [prometheus-cache-monitor1,9478d94883de1b45,ee28b0342410a54e] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:46:20.763 INFO 9 --- [ocp-async-4,00a4a7e8a1448a9e,0bdee7a016aca546] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:20.763 WARN 9 --- [ocp-async-2,d4428a819f57b0df,18863b3b25acc278] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:21.402 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:21.402 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:22.636 INFO 9 --- [prometheus-minute-schedule-1,f18fef3bdf250748,6afab04ad914a1ed] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:22.639 INFO 9 --- [prometheus-minute-schedule-1,f18fef3bdf250748,6afab04ad914a1ed] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:22.763 INFO 9 --- [ocp-async-6,60350783ac2ad7de,cd9e7e25e3793024] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:22.763 WARN 9 --- [ocp-async-10,b5c4e38fed25d3d9,19cbcc9df3c8a2ff] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:24.402 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:24.403 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:24.602 INFO 9 --- [ocp-schedules-12,c6f32e6c43748734,0b332dd028edf1a2] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:46:24.763 INFO 9 --- [ocp-async-7,24510591c1717a13,c4d155aa781164e3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:24.763 WARN 9 --- [ocp-async-9,f60b1a74757cb5cb,b4f0196d082f2447] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:25.636 INFO 9 --- [prometheus-minute-schedule-1,35404d92d46dc7ad,273406c06b767eee] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:25.639 INFO 9 --- [prometheus-minute-schedule-1,35404d92d46dc7ad,273406c06b767eee] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:26.763 WARN 9 --- [ocp-async-2,7cbc84d8efec5774,dd653c542bcf3d29] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:26.763 INFO 9 --- [ocp-async-8,fadc2119dd731225,6f7c0527e0e7bca7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:27.403 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:27.403 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:28.636 INFO 9 --- [prometheus-minute-schedule-1,6c1659d76d869f51,dcec7b0ba3bff066] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:28.639 INFO 9 --- [prometheus-minute-schedule-1,6c1659d76d869f51,dcec7b0ba3bff066] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:28.739 INFO 9 --- [ocp-schedules-5,ff2b0cf91e23da85,91cccaebfc602e26] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:46:28.742 INFO 9 --- [ocp-schedules-5,ff2b0cf91e23da85,91cccaebfc602e26] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:46:28.763 WARN 9 --- [ocp-async-10,18274ffa383fd446,7a5ab1e91b20e8d6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:28.763 INFO 9 --- [ocp-async-4,c8dac3687691cc03,e97e1295c20aa30f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:29.637 INFO 9 --- [ocp-schedules-19,132b4dfac9e1a76b,ca53c3cf748b01cd] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:46:29.642 WARN 9 --- [scanner-1362387-1,132b4dfac9e1a76b,c4ba6e9bfdf4af93] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:46:29.938 INFO 9 --- [ocp-schedules-12,37c1ce1bda9e64ec,907693ccb7b7f188] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:46:29.941 INFO 9 --- [ocp-schedules-30,d35675e49494bf07,563aada00be8ff4c] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:46:29.941 INFO 9 --- [ocp-schedules-11,5dfdd3545b6b29eb,55d119f71ccf514d] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:46:29.942 INFO 9 --- [ocp-schedules-21,9a6d5368a8594b98,fdb1c0eef3ef0430] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:46:29.942 INFO 9 --- [ocp-schedules-30,d35675e49494bf07,563aada00be8ff4c] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:29.942 INFO 9 --- [ocp-schedules-11,5dfdd3545b6b29eb,55d119f71ccf514d] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:29.943 INFO 9 --- [ocp-schedules-21,9a6d5368a8594b98,fdb1c0eef3ef0430] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:29.943 INFO 9 --- [ocp-schedules-21,9a6d5368a8594b98,fdb1c0eef3ef0430] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:46:29.944 INFO 9 --- [ocp-schedules-17,b68cc81dc01b8c47,2615c7f691dab1b3] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:46:29.944 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:46:29.944 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:46:29.944 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:46:29.944 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:46:29.944 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:46:29.944 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:46:29.945 INFO 9 --- [ocp-schedules-12,00ba5d19138f422c,29298ca0791dccb3] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:46:29.945 INFO 9 --- [ocp-schedules-25,0d27b68b9f0cb7c7,18652dbbd90321bd] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:46:29.945 INFO 9 --- [host-check-clockdiff1,00ba5d19138f422c,2c11d70f9009c597] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:46:29.945 INFO 9 --- [host-check-clockdiff2,00ba5d19138f422c,9914d87f4bb3184c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:46:29.945 INFO 9 --- [host-check-agent-status1,0d27b68b9f0cb7c7,a57b39dd04620b6b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:46:29.945 INFO 9 --- [host-check-clockdiff3,00ba5d19138f422c,044615fa5493fa3b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:46:29.945 INFO 9 --- [host-check-agent-status2,0d27b68b9f0cb7c7,563b9e638e532328] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:46:29.945 INFO 9 --- [host-check-clockdiff4,00ba5d19138f422c,c3879a87ce78f11c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:46:29.945 INFO 9 --- [host-check-agent-status3,0d27b68b9f0cb7c7,bd83db48add4651d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:46:29.945 INFO 9 --- [host-check-clockdiff5,00ba5d19138f422c,579d86ba3c15d95c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:46:29.945 INFO 9 --- [host-check-agent-status4,0d27b68b9f0cb7c7,3043743498943aa5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:46:29.946 INFO 9 --- [host-check-clockdiff6,00ba5d19138f422c,cfce89c86a05cd5c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:46:29.946 INFO 9 --- [host-check-agent-status5,0d27b68b9f0cb7c7,97525464c6698259] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:46:29.946 INFO 9 --- [host-check-agent-status6,0d27b68b9f0cb7c7,fc2443f42c8cf3f1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:46:29.947 INFO 9 --- [ocp-schedules-16,446c9440d01b15dd,1a48b203d7498080] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:46:29.949 INFO 9 --- [host-check-clockdiff1,00ba5d19138f422c,2c11d70f9009c597] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001589 -1 -1 , error= 2025-09-16 13:46:29.949 INFO 9 --- [host-check-clockdiff3,00ba5d19138f422c,044615fa5493fa3b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001589 -1 -1 , error= 2025-09-16 13:46:29.952 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:46:29.952 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:46:29.952 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:46:29.953 INFO 9 --- [host-check-clockdiff2,00ba5d19138f422c,9914d87f4bb3184c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001589 -1 -1 , error= 2025-09-16 13:46:29.953 INFO 9 --- [host-check-clockdiff6,00ba5d19138f422c,cfce89c86a05cd5c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001589 -1 -1 , error= 2025-09-16 13:46:29.953 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:46:29.953 INFO 9 --- [host-check-agent-status1,0d27b68b9f0cb7c7,a57b39dd04620b6b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:46:29.953 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:46:29.953 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:29.954 INFO 9 --- [host-check-agent-status4,0d27b68b9f0cb7c7,3043743498943aa5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:46:29.954 INFO 9 --- [host-check-agent-status3,0d27b68b9f0cb7c7,bd83db48add4651d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:46:29.954 INFO 9 --- [host-check-agent-status6,0d27b68b9f0cb7c7,fc2443f42c8cf3f1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:29.954 INFO 9 --- [host-check-agent-status5,0d27b68b9f0cb7c7,97525464c6698259] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:46:29.954 INFO 9 --- [host-check-clockdiff5,00ba5d19138f422c,579d86ba3c15d95c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001589 -1 -1 , error= 2025-09-16 13:46:29.954 INFO 9 --- [host-check-agent-status2,0d27b68b9f0cb7c7,563b9e638e532328] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:46:29.955 INFO 9 --- [host-check-agent-status3,0d27b68b9f0cb7c7,bd83db48add4651d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:46:29.955 INFO 9 --- [host-check-agent-status1,0d27b68b9f0cb7c7,a57b39dd04620b6b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:46:29.955 INFO 9 --- [host-check-agent-status5,0d27b68b9f0cb7c7,97525464c6698259] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:46:29.955 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:46:29.955 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:46:29.955 INFO 9 --- [host-check-agent-status6,0d27b68b9f0cb7c7,fc2443f42c8cf3f1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:29.955 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:46:29.955 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:46:29.955 INFO 9 --- [host-check-agent-status4,0d27b68b9f0cb7c7,3043743498943aa5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:46:29.955 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:46:29.955 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:29.955 INFO 9 --- [host-check-agent-status2,0d27b68b9f0cb7c7,563b9e638e532328] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:46:29.962 INFO 9 --- [ocp-schedules-26,d9deb6f984ae5241,b70cbaebc6e9a566] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:46:29.963 INFO 9 --- [ocp-schedules-20,a5e956cc79aa905c,7c31248da997d184] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:46:29.967 INFO 9 --- [ocp-schedules-26,d9deb6f984ae5241,b70cbaebc6e9a566] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:46:29.969 INFO 9 --- [host-check-agent-status3,0d27b68b9f0cb7c7,bd83db48add4651d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:46:29.969 INFO 9 --- [host-check-agent-status2,0d27b68b9f0cb7c7,563b9e638e532328] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:46:29.969 INFO 9 --- [host-check-agent-status6,0d27b68b9f0cb7c7,fc2443f42c8cf3f1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:46:29.969 INFO 9 --- [host-check-agent-status1,0d27b68b9f0cb7c7,a57b39dd04620b6b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:46:29.970 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:46:29.970 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:46:29.970 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:46:29.970 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:46:29.970 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:46:29.970 INFO 9 --- [ocp-schedules-20,a5e956cc79aa905c,7c31248da997d184] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:46:29.970 INFO 9 --- [host-check-agent-status5,0d27b68b9f0cb7c7,97525464c6698259] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:46:29.970 INFO 9 --- [host-check-agent-status4,0d27b68b9f0cb7c7,3043743498943aa5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:46:29.971 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:46:29.971 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:46:29.970507306+08:00 2025-09-16 13:46:29.971 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:46:29.970490346+08:00 2025-09-16 13:46:29.971 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:46:29.970878348+08:00 2025-09-16 13:46:29.971 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:46:29.970324322+08:00 2025-09-16 13:46:29.971 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:46:29.971001217+08:00 2025-09-16 13:46:29.972 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:46:29.971+08:00 2025-09-16 13:46:29.972 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:46:29.971+08:00 2025-09-16 13:46:29.972 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:46:29.971+08:00 2025-09-16 13:46:29.972 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:46:29.971+08:00 2025-09-16 13:46:29.972 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:46:29.972+08:00 2025-09-16 13:46:29.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:29.972 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:46:29.971461572+08:00 2025-09-16 13:46:29.973 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:46:29.972+08:00 2025-09-16 13:46:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status3,0d27b68b9f0cb7c7,bd83db48add4651d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status3,0d27b68b9f0cb7c7,bd83db48add4651d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status3,0d27b68b9f0cb7c7,bd83db48add4651d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status5,0d27b68b9f0cb7c7,97525464c6698259] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status5,0d27b68b9f0cb7c7,97525464c6698259] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status2,0d27b68b9f0cb7c7,563b9e638e532328] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status5,0d27b68b9f0cb7c7,97525464c6698259] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status2,0d27b68b9f0cb7c7,563b9e638e532328] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:46:29.973 INFO 9 --- [host-check-agent-status2,0d27b68b9f0cb7c7,563b9e638e532328] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:46:29.973 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:46:29.971+08:00 and status AVAILABLE 2025-09-16 13:46:29.973 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:46:29.971+08:00 and status AVAILABLE 2025-09-16 13:46:29.974 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:46:29.971+08:00 and status AVAILABLE 2025-09-16 13:46:29.974 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:46:29.972+08:00 and status AVAILABLE 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status1,0d27b68b9f0cb7c7,a57b39dd04620b6b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status1,0d27b68b9f0cb7c7,a57b39dd04620b6b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status1,0d27b68b9f0cb7c7,a57b39dd04620b6b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status6,0d27b68b9f0cb7c7,fc2443f42c8cf3f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:46:29.974 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:46:29.971+08:00 and status AVAILABLE 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status6,0d27b68b9f0cb7c7,fc2443f42c8cf3f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status6,0d27b68b9f0cb7c7,fc2443f42c8cf3f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status4,0d27b68b9f0cb7c7,3043743498943aa5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status4,0d27b68b9f0cb7c7,3043743498943aa5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:46:29.974 INFO 9 --- [host-check-agent-status4,0d27b68b9f0cb7c7,3043743498943aa5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:46:29.975 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:46:29.972+08:00 and status AVAILABLE 2025-09-16 13:46:29.977 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:46:29.977 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:46:29.977 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:46:29.977 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:46:29.977 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:46:29.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:46:29.978 INFO 9 --- [ocp-schedules-11,5dfdd3545b6b29eb,55d119f71ccf514d] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:46:29.979 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:46:29.983 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:46:29.983 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:46:29.983 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:46:29.984 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:46:29.984 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:46:29.984 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:46:29.984 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:46:29.984 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:46:29.984 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:46:29.985 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:46:29.985 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:29.986 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:29.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:46:29.998 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:29.998 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:29.998 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:29.998 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:29.999 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:30.001 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:46:30.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:46:30.004458+08:00, lastProcessTime=2025-09-16T13:46:20.007989+08:00 2025-09-16 13:46:30.026 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:46:30.027 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:46:30.028 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:46:30.028 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:30.028 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:46:30.029 INFO 9 --- [ocp-schedules-10,f28307519140f064,13f86c2bc469f9e6] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:46:30.029 INFO 9 --- [ocp-schedules-10,f28307519140f064,13f86c2bc469f9e6] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:46:30.029 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:46:30.032 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:46:30.032 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:46:30.033 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:46:30.033 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:46:30.034 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:46:30.035 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:46:30.038 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:46:30.039 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:46:30.045 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:30.045 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:30.045 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:30.047 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:30.049 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:30.051 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:46:30.063 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:30.064 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:30.065 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:46:30.069 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:46:30.072 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:46:30.072 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:30.073 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:46:30.073 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:46:30.076 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:46:30.076 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:46:30.077 INFO 9 --- [ocp-schedules-8,b918befacc13d1e6,83108ddc6a3f0fbc] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:46:30.078 INFO 9 --- [ocp-schedules-8,b918befacc13d1e6,83108ddc6a3f0fbc] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:46:30.079 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:46:30.079 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:46:30.079 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:46:30.080 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:46:30.082 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:46:30.083 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:46:30.085 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:46:30.087 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.087 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:30.091 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:30.091 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:30.091 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:30.093 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:30.094 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:30.096 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:46:30.101 INFO 9 --- [prometheus-second-schedule-1,e420d70550352da8,b0691971ff4657f0] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:46:30.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:30.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:30.118 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:46:30.118 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:46:30.119 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:46:30.119 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:46:30.123 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:46:30.125 INFO 9 --- [host-check-host-status2,b68cc81dc01b8c47,c58f896684538f7b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:46:30.125 INFO 9 --- [host-check-host-status4,b68cc81dc01b8c47,66ec80308be616ca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:46:30.125 INFO 9 --- [host-check-host-status5,b68cc81dc01b8c47,2bbb67123903f3a9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:46:30.126 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:46:30.126 INFO 9 --- [host-check-host-status1,b68cc81dc01b8c47,a3243bdc97aa879e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:46:30.131 INFO 9 --- [host-check-host-status3,b68cc81dc01b8c47,eee5f0f24b975433] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:46:30.133 INFO 9 --- [host-check-host-status6,b68cc81dc01b8c47,b2f14a28ad7e6d73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:46:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:30.136 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:46:30.004458+08:00 2025-09-16 13:46:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:30.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:30.178 INFO 9 --- [ocp-async-10,1d2af3817a758c55,43b70d2ce1179010] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:46:30.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:30.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:46:30.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:46:30.222 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:46:30.236 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:30.237 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:30.238 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:46:30.243 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:46:30.246 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:46:30.248 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:30.249 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:30.261 INFO 9 --- [ocp-schedules-14,e94801311a34c49e,128f6b05041a581c] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:46:30.262 INFO 9 --- [ocp-schedules-14,e94801311a34c49e,128f6b05041a581c] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:30.262 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:46:30.262 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:46:30.262 INFO 9 --- [ocp-schedules-14,e94801311a34c49e,128f6b05041a581c] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:46:30.323 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:46:30.337 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:30.338 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:30.339 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:46:30.353 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:46:30.353 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:46:30.353 INFO 9 --- [ocp-schedules-30,d35675e49494bf07,563aada00be8ff4c] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:46:30.386 INFO 9 --- [ocp-schedules-9,9f7c9b9bd50480be,f69ffab0d0ddadb6] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:46:30.404 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:30.404 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:30.561 INFO 9 --- [ocp-schedules-16,daaf25dcd5227dcc,60f782f2d78e84a1] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:46:30.563 INFO 9 --- [ocp-schedules-16,daaf25dcd5227dcc,60f782f2d78e84a1] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:46:30.563 INFO 9 --- [ocp-schedules-16,daaf25dcd5227dcc,60f782f2d78e84a1] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:46:30.763 INFO 9 --- [ocp-async-9,86495f1991f1b4f4,f1e41c9344c2c37a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:30.763 WARN 9 --- [ocp-async-1,7cff3a61be83e810,1adab3aad988b1dd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:30.813 INFO 9 --- [ocp-schedules-10,f0861f5807ddaaac,836ceebc1089056c] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:46:30.950 INFO 9 --- [ocp-schedules-6,196e87332db277af,9360083df406c675] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:46:30.950 INFO 9 --- [ocp-schedules-6,196e87332db277af,9360083df406c675] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:46:31.417 INFO 9 --- [ocp-schedules-24,1b8f4421f11179fa,d4d3056845729391] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:46:31.417 INFO 9 --- [ocp-schedules-24,1b8f4421f11179fa,d4d3056845729391] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001591 2025-09-16 13:46:31.417 INFO 9 --- [ocp-schedules-24,1b8f4421f11179fa,d4d3056845729391] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:46:31.495 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,504e417288c90cd0,e279cc8ee1ea6bf9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=504e417288c90cd0, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:46:31.495 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,504e417288c90cd0,e279cc8ee1ea6bf9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=504e417288c90cd0, duration=1 ms] 2025-09-16 13:46:31.592 INFO 9 --- [ocp-schedules-14,29d99c2bf7fa6fe2,8a313b2858ff172d] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:46:31.636 INFO 9 --- [prometheus-minute-schedule-1,4a544a2ab7a879e9,15b171cd43ca5948] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:31.639 INFO 9 --- [prometheus-minute-schedule-1,4a544a2ab7a879e9,15b171cd43ca5948] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:31.644 INFO 9 --- [ocp-schedules-5,3c8e25ac3f37fd18,d5d6a133b6b8fa04] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:46:31.667 INFO 9 --- [ocp-schedules-30,df6fb37665aa1072,25f42d26b6865f9e] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:46:31.667 INFO 9 --- [ocp-schedules-30,df6fb37665aa1072,25f42d26b6865f9e] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:46:31.668 INFO 9 --- [ocp-schedules-30,df6fb37665aa1072,25f42d26b6865f9e] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:46:31.668 INFO 9 --- [ocp-schedules-30,df6fb37665aa1072,25f42d26b6865f9e] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:46:31.668 INFO 9 --- [ocp-schedules-30,df6fb37665aa1072,25f42d26b6865f9e] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:46:31.668 INFO 9 --- [ocp-schedules-30,df6fb37665aa1072,25f42d26b6865f9e] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:46:31.704 INFO 9 --- [ocp-schedules-9,24945d709b700d03,80ed8c20cdb85b6b] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:46:31.705 INFO 9 --- [ocp-schedules-9,24945d709b700d03,80ed8c20cdb85b6b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:31.719 INFO 9 --- [ocp-schedules-9,24945d709b700d03,80ed8c20cdb85b6b] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:46:32.763 INFO 9 --- [ocp-async-10,ff1cc2b756c337cf,2615f9ce459156ac] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:32.763 WARN 9 --- [ocp-async-5,78d8be97bc2b9552,6d50cd1152ad6874] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:33.098 INFO 9 --- [host-check-clockdiff4,00ba5d19138f422c,c3879a87ce78f11c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001593 0 0 , error= 2025-09-16 13:46:33.306 INFO 9 --- [ocp-schedules-29,03098e0841d7b0fc,9f64e708aeef0907] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:46:33.404 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:33.405 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:33.429 INFO 9 --- [ocp-schedules-16,a8debc5fe1943ead,a3043c1fd211b1ff] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:46:33.429+08:00, clusters=[1] 2025-09-16 13:46:33.431 INFO 9 --- [ocp-schedules-16,a8debc5fe1943ead,a3043c1fd211b1ff] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:46:33.985 INFO 9 --- [ocp-schedules-22,5cb77221867c90ee,0fa4a257b27b21ac] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:46:33.985 INFO 9 --- [ocp-schedules-22,5cb77221867c90ee,0fa4a257b27b21ac] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:46:33.986 INFO 9 --- [ocp-schedules-22,5cb77221867c90ee,0fa4a257b27b21ac] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:46:34.001 INFO 9 --- [ocp-schedules-22,5cb77221867c90ee,0fa4a257b27b21ac] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:46:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:46:34.485 INFO 9 --- [ocp-schedules-2,f376da9a4b441517,3332dfaa5cfe6cef] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:46:34.490 INFO 9 --- [ocp-schedules-2,f376da9a4b441517,3332dfaa5cfe6cef] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:46:34.490 INFO 9 --- [ocp-schedules-2,f376da9a4b441517,3332dfaa5cfe6cef] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:46:34.605 INFO 9 --- [ocp-schedules-25,3504fdb19bc990c0,fc3b94b334b0f805] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:46:34.636 INFO 9 --- [prometheus-minute-schedule-1,93f9db8bfcc91d88,c4417fdfadb0f7e9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:34.639 INFO 9 --- [prometheus-minute-schedule-1,93f9db8bfcc91d88,c4417fdfadb0f7e9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:34.763 WARN 9 --- [ocp-async-6,815c7100aca87103,efc7c0b028bd8724] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:34.763 INFO 9 --- [ocp-async-4,885228534977bb0e,5344705b91b1ab16] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:35.459 INFO 9 --- [ocp-schedules-29,7eb0cfd30a5c2e17,4d02a3a13bbd80ee] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:46:35.459+08:00, clusters=[1] 2025-09-16 13:46:35.464 INFO 9 --- [ocp-schedules-29,7eb0cfd30a5c2e17,4d02a3a13bbd80ee] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:46:36.405 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:36.406 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:36.764 INFO 9 --- [ocp-async-1,3a954308abe152ed,bcad428bd68d721b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:36.764 WARN 9 --- [ocp-async-2,06881a2324ca94b4,4d73711dd380f139] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:37.522 INFO 9 --- [ocp-schedules-7,9e1f478702e876b5,c61bb9e46fb20749] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:46:37.523 INFO 9 --- [ocp-schedules-7,9e1f478702e876b5,c61bb9e46fb20749] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:37.544 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:37.544 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:46:37.558 INFO 9 --- [ocp-schedules-7,9e1f478702e876b5,c61bb9e46fb20749] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:46:37.636 INFO 9 --- [prometheus-minute-schedule-1,b99db7dd0c5e8043,a04780088f5deb26] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:37.639 INFO 9 --- [prometheus-minute-schedule-1,b99db7dd0c5e8043,a04780088f5deb26] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:38.746 INFO 9 --- [ocp-schedules-17,e1c1da7c48a80e2c,b34790f1d0e9a6f8] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:46:38.748 INFO 9 --- [ocp-schedules-17,e1c1da7c48a80e2c,b34790f1d0e9a6f8] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:46:38.764 INFO 9 --- [ocp-async-5,6bf2721934af1e67,44b4ab5d530ce452] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:38.764 WARN 9 --- [ocp-async-9,8b85478b923b4915,ae2e51d8653268d6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:39.406 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:39.407 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:39.516 INFO 9 --- [ocp-schedules-29,b170c3738668a59e,a07b46b71ec63a1d] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:46:39.517 INFO 9 --- [ocp-schedules-29,b170c3738668a59e,a07b46b71ec63a1d] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:46:39.523 INFO 9 --- [ocp-schedules-15,39b180657d92c04a,0cd76b43f5e13b8e] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:46:39.524 INFO 9 --- [ocp-schedules-15,39b180657d92c04a,0cd76b43f5e13b8e] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:46:39.524 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:46:39.524 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:46:39.524 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:46:39.524 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:46:39.527 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:46:39.527 INFO 9 --- [ocp-schedules-15,39b180657d92c04a,0cd76b43f5e13b8e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:46:39.527 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:46:39.527 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:39.528 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:46:39.528 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:46:39.528 INFO 9 --- [ocp-schedules-15,39b180657d92c04a,0cd76b43f5e13b8e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:46:39.528 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:39.528 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:46:39.529 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:46:39.533 INFO 9 --- [Collect all tenants major compactions1,b170c3738668a59e,7e972674c6d4cf7e] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:46:39.533 INFO 9 --- [Collect all tenants major compactions2,b170c3738668a59e,dc2b59bab504a68b] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:46:39.534 INFO 9 --- [Collect all tenants major compactions3,b170c3738668a59e,1cb40bfa2d42e7b7] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:46:39.542 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:46:39.542 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:46:39.543 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:46:39.543 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:46:39.543 INFO 9 --- [ocp-schedules-15,39b180657d92c04a,0cd76b43f5e13b8e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:46:39.545 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:46:39.548 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:46:39.549 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:46:39.553 INFO 9 --- [Collect all tenants major compactions1,b170c3738668a59e,7e972674c6d4cf7e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:39.553 INFO 9 --- [Collect all tenants major compactions3,b170c3738668a59e,1cb40bfa2d42e7b7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:39.553 INFO 9 --- [Collect all tenants major compactions2,b170c3738668a59e,dc2b59bab504a68b] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:39.554 INFO 9 --- [Collect all tenants major compactions1,b170c3738668a59e,7e972674c6d4cf7e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:46:39.555 INFO 9 --- [Collect all tenants major compactions3,b170c3738668a59e,1cb40bfa2d42e7b7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:46:39.555 INFO 9 --- [Collect all tenants major compactions2,b170c3738668a59e,dc2b59bab504a68b] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:46:39.559 INFO 9 --- [Collect all tenants major compactions1,b170c3738668a59e,7e972674c6d4cf7e] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:46:39.559 INFO 9 --- [Collect all tenants major compactions3,b170c3738668a59e,1cb40bfa2d42e7b7] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:46:39.559 INFO 9 --- [Collect all tenants major compactions2,b170c3738668a59e,dc2b59bab504a68b] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:46:39.560 INFO 9 --- [ocp-schedules-29,b170c3738668a59e,a07b46b71ec63a1d] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:46:39.562 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:46:39.564 INFO 9 --- [ocp-schedules-15,39b180657d92c04a,0cd76b43f5e13b8e] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:46:39.666 INFO 9 --- [ocp-schedules-27,eec1c07266fcd3ff,1c351b795dd07066] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:46:39.671 WARN 9 --- [scanner-1362517-1,eec1c07266fcd3ff,ad26f15d15b370cb] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:46:39.696 INFO 9 --- [alarm-detect-17,eec1c07266fcd3ff,c2977b4349cb3ea8] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:46:39.698 INFO 9 --- [alarm-detect-12,eec1c07266fcd3ff,5a578e728868c957] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:46:39.698 INFO 9 --- [alarm-detect-20,eec1c07266fcd3ff,54ba200c38429f68] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:46:39.710 INFO 9 --- [alarm-detect-4,eec1c07266fcd3ff,b1834759e6d26ec8] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:46:40.002 INFO 9 --- [ocp-schedules-2,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:46:40.002 INFO 9 --- [ocp-schedules-14,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:46:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:46:40.003696+08:00, lastProcessTime=2025-09-16T13:46:30.004458+08:00 2025-09-16 13:46:40.125 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:46:40.003696+08:00 2025-09-16 13:46:40.178 INFO 9 --- [ocp-async-4,70a83260fbcc94d2,9915b68da8b3055f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:46:40.636 INFO 9 --- [prometheus-minute-schedule-1,f9e6fdfe7a7f9a15,4f640e2a6ff7be45] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:40.639 INFO 9 --- [prometheus-minute-schedule-1,f9e6fdfe7a7f9a15,4f640e2a6ff7be45] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:40.764 INFO 9 --- [ocp-async-3,3e40aaa0f62bacb3,d6ebbaf2840e91a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:40.764 WARN 9 --- [ocp-async-2,57740be876613274,18ed4fe4a207d8ac] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:41.858 INFO 9 --- [ocp-schedules-7,93f6501e0ed68115,52625c5c50e82639] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:46:41.859 INFO 9 --- [ocp-schedules-7,93f6501e0ed68115,52625c5c50e82639] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:41.901 INFO 9 --- [ocp-schedules-29,4a5732621fe29faf,6af42a6d02da1685] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:46:41.901 INFO 9 --- [ocp-schedules-29,4a5732621fe29faf,6af42a6d02da1685] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:46:41.906 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:46:41.906 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:41.909 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:46:41.932 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:41.933 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:46:41.935 INFO 9 --- [ocp-schedules-29,4a5732621fe29faf,6af42a6d02da1685] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:41.936 INFO 9 --- [ocp-schedules-29,4a5732621fe29faf,6af42a6d02da1685] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:46:41.953 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:41.953 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:46:41.977 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:41.977 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:46:41.982 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:41.983 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:46:42.003 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.004 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:46:42.027 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.028 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:46:42.032 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.033 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:46:42.056 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.057 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:46:42.080 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.080 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:46:42.097 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.098 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:46:42.099 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.100 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:46:42.101 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.101 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:46:42.102 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.103 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:46:42.103 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.104 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:46:42.105 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.105 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:46:42.121 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.122 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:46:42.123 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.124 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:46:42.125 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.125 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:46:42.141 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:46:42.142 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:46:42.168 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:46:42.170 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:42.170 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:46:42.202 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:46:42.202 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:46:42.202 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:46:42.202 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:46:42.202 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:46:42.202 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:46:42.204 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:46:42.204 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:46:42.204 INFO 9 --- [ocp-schedules-7,93f6501e0ed68115,52625c5c50e82639] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:46:42.407 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:42.407 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:42.764 INFO 9 --- [ocp-async-4,a6f617cb7ea0ed71,68ff470d6d206e89] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:42.764 WARN 9 --- [ocp-async-9,745a9e594f5fe696,1c20b535505a51ce] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 13:46:42,888 |-INFO in ReconfigureOnChangeTask(born:1758001422888) - Empty watch file list. Disabling 2025-09-16 13:46:43.241 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 13:46:43.241 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 13:46:43.244 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:46:43.244 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:46:43.244 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:46:43.244 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:46:43.247 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:46:43.247 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:46:43.247 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:46:43.247 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:46:43.264 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:46:43.268 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:46:43.268 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:46:43.268 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:46:43.268 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:46:43.268 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:46:43.273 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:46:43.530 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 13:46:43.636 INFO 9 --- [prometheus-minute-schedule-1,9a03f20958d9d36c,fcc38dda0f18361b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:43.639 INFO 9 --- [prometheus-minute-schedule-1,9a03f20958d9d36c,fcc38dda0f18361b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:43.803 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.556139049S 2025-09-16 13:46:43.803 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:46:43.855 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 13:46:43.855 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 13:46:43.885 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 13:46:43,897 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:46:43,898 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:46:43,898 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:46:43,898 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:46:43,899 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:46:43,899 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:46:43,897 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:46:43,898 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:46:43,898 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:46:43,898 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:46:43,899 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:46:43,899 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:46:43,899 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@1545c26a - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 13:46:43,902 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 13:46:43,902 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 13:46:43,903 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 13:46:43,903 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@1545c26a - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 13:46:43,904 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 13:46:43,904 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 13:46:43,904 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 13:46:43,904 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 13:46:43,904 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 13:46:43,905 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:46:43,905 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 13:46:43,905 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:46:43,905 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:46:43,905 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:46:43,905 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 13:46:43,905 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 13:46:43,905 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 13:46:43,905 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 13:46:43,906 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:46:43,906 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 13:46:43,906 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@2107770480 - setting totalSizeCap to 10 GB 13:46:43,906 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@2107770480 - Archive files will be limited to [100 MB] each. 13:46:43,906 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@2107770480 - Will use gz compression 13:46:43,906 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@2107770480 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 13:46:43,906 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@464fdd3c - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 13:46:43,906 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@464fdd3c - Roll-over at midnight. 13:46:43,906 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@464fdd3c - Setting initial period to Tue Sep 16 13:46:43 CST 2025 13:46:43,906 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@2107770480 - Cleaning on start up 13:46:43,906 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 13:46:43,906 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 13:46:43,907 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 13:46:43,907 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 13:46:43,907 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 13:46:43,907 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 13:46:43,907 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1711352378 - setting totalSizeCap to 10 GB 13:46:43,907 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1711352378 - Archive files will be limited to [100 MB] each. 13:46:43,907 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1711352378 - Will use gz compression 13:46:43,907 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1711352378 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 13:46:43,907 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@b7d310c - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 13:46:43,907 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@b7d310c - Roll-over at midnight. 13:46:43,907 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@b7d310c - Setting initial period to Tue Sep 16 13:46:31 CST 2025 13:46:43,907 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 13:46:43,907 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 13:46:43,907 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 13:46:43,907 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 13:46:43,907 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 13:46:43,907 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 13:46:43,907 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 13:46:43,907 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 13:46:43,908 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 13:46:43,908 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 13:46:43,908 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating INFO level on Logger[ROOT] onto the JUL framework 13:46:43,908 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 13:46:43,908 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 13:46:43,908 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 13:46:43,908 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:46:43,908 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@33e3bb62 - Registering current configuration as safe fallback point 13:46:43,909 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 13:46:43,912 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating INFO level on Logger[web] onto the JUL framework 13:46:43,912 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 13:46:43,912 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@42d36300 - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 13:46:43.913 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:46:43.913 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:46:43.913 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:46:43.913 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:46:43.913 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:46:43.913 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 13:46:43.919 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:46:44.007 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] o.s.boot.SpringApplication : Started application in 0.763 seconds (JVM running for 12579.052) 2025-09-16 13:46:44.007 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.763631573S 2025-09-16 13:46:44.256 INFO 9 --- [ocp-schedules-13,f63d69a1452e7630,26530dff6d95deb2] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 13:46:44.609 INFO 9 --- [ocp-schedules-2,1bd1cf96d9452f23,e9b8dc58d0f55ba9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:46:44.764 WARN 9 --- [ocp-async-8,22f6a612eb3ec96b,e92f8ed200fad7e7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:44.764 INFO 9 --- [ocp-async-5,bfd2120656fc5505,878a352989adc299] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:45.407 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:45.408 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:46.636 INFO 9 --- [prometheus-minute-schedule-1,1e4f288b17634828,f0e73d31a586c48e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:46.639 INFO 9 --- [prometheus-minute-schedule-1,1e4f288b17634828,f0e73d31a586c48e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:46.764 WARN 9 --- [ocp-async-2,67469319fddbb8b1,79e845f3db82f050] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:46.764 INFO 9 --- [ocp-async-10,bb7a03eb20aecbc3,24d71777443ed198] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:48.408 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:48.409 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:48.752 INFO 9 --- [ocp-schedules-3,d237ea231db44751,4539a215be242bfa] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:46:48.754 INFO 9 --- [ocp-schedules-3,d237ea231db44751,4539a215be242bfa] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:46:48.764 WARN 9 --- [ocp-async-9,da048b4ac0defbba,0ed3a27264cd2016] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:48.764 INFO 9 --- [ocp-async-1,e1ebfd938fd61927,ae24c7f7d2d79a4d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:49.237 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:49.237 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:46:49.238 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:49.239 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:46:49.240 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:46:49.252 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:46:49.265 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:46:49.265 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:46:49.265 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:46:49.265 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:46:49.265 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:44:30, target=2025-09-16T13:42:30, granule=120000ms, delay=120000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:44:30, target=2025-09-16T13:42:30, granule=120000ms, delay=120000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:44:30, target=2025-09-16T13:42:30, granule=120000ms, delay=120000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:44:30, target=2025-09-16T13:42:30, granule=120000ms, delay=120000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:44:30, target=2025-09-16T13:42:30, granule=120000ms, delay=120000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:42:30, target=2025-09-16T13:37:30, granule=600000ms, delay=300000ms) 2025-09-16 13:46:49.267 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=27ms, period=120000ms 2025-09-16 13:46:49.636 INFO 9 --- [prometheus-minute-schedule-1,c095c0c81364334e,3edac4fd89232465] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:49.639 INFO 9 --- [prometheus-minute-schedule-1,c095c0c81364334e,3edac4fd89232465] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:49.713 INFO 9 --- [ocp-schedules-5,70e0931d1a782565,daed71fea9d60b0c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:46:49.717 WARN 9 --- [scanner-1362675-1,70e0931d1a782565,b0d0b37d70ecfe57] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:46:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:46:50.002786+08:00, lastProcessTime=2025-09-16T13:46:40.003696+08:00 2025-09-16 13:46:50.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:46:50.002786+08:00 2025-09-16 13:46:50.178 INFO 9 --- [ocp-async-2,ffc8c0f930a2ae96,97123275cb52a683] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:46:50.764 WARN 9 --- [ocp-async-7,11c0301de3b77606,f0b10b5c101853bb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:50.764 INFO 9 --- [ocp-async-5,7a5827ea153ea427,49ea4ecf3899d32c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:51.409 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:51.409 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:52.636 INFO 9 --- [prometheus-minute-schedule-1,432648c106966fba,c11fab80cc02a7d5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:52.639 INFO 9 --- [prometheus-minute-schedule-1,432648c106966fba,c11fab80cc02a7d5] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:52.764 WARN 9 --- [ocp-async-6,eb4c282d62dac3a3,9bd5847f4069c011] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:52.764 INFO 9 --- [ocp-async-10,406308b6979d5b84,e58f895746b9799b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:54.409 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:54.410 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:54.492 INFO 9 --- [ocp-schedules-17,0d3219b76b83502f,d09a94bec2de89ae] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:46:54.496 INFO 9 --- [ocp-schedules-17,0d3219b76b83502f,d09a94bec2de89ae] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:46:54.496 INFO 9 --- [ocp-schedules-17,0d3219b76b83502f,d09a94bec2de89ae] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:46:54.612 INFO 9 --- [ocp-schedules-10,cefa4447bc400b58,c867695eedebe0a5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:46:54.765 WARN 9 --- [ocp-async-3,5a74aa7e32ff5cbb,63611710aca186d8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:54.765 INFO 9 --- [ocp-async-1,09f8a3639f484962,2193392fe14b22de] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:55.636 INFO 9 --- [prometheus-minute-schedule-1,1e0d7cbd7976f66d,09b172733f0afe05] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:55.639 INFO 9 --- [prometheus-minute-schedule-1,1e0d7cbd7976f66d,09b172733f0afe05] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:56.765 WARN 9 --- [ocp-async-7,3ff312c9fe02b650,4e4c1ba4b66adadf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:56.765 INFO 9 --- [ocp-async-8,c1a374f6919e178e,60e0112614ec78ee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:57.410 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:46:57.411 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:46:58.636 INFO 9 --- [prometheus-minute-schedule-1,6b419351b94974c2,de9bbc557810ac44] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001620, interval=60 2025-09-16 13:46:58.639 INFO 9 --- [prometheus-minute-schedule-1,6b419351b94974c2,de9bbc557810ac44] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:46:58.758 INFO 9 --- [ocp-schedules-16,59f7959da8e79f68,25e0a8f26a66308f] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:46:58.760 INFO 9 --- [ocp-schedules-16,59f7959da8e79f68,25e0a8f26a66308f] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:46:58.765 WARN 9 --- [ocp-async-6,ee73762f5554c66c,d66631f6e40344d9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:46:58.765 INFO 9 --- [ocp-async-2,2da13a7a28baa7e5,52eefba28f0b93f8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:46:59.745 INFO 9 --- [ocp-schedules-20,42c56db83552d9a1,330ee03488486256] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:46:59.751 WARN 9 --- [scanner-1362806-1,42c56db83552d9a1,0a7f604a8dd8f914] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:46:59.763 INFO 9 --- [alarm-detect-1,42c56db83552d9a1,62f6a12bf28e798f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:46:59.765 INFO 9 --- [alarm-detect-7,42c56db83552d9a1,954e3ffbbec54a06] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:46:59.765 INFO 9 --- [alarm-detect-16,42c56db83552d9a1,3247cd79afefbddc] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:46:59.778 INFO 9 --- [alarm-detect-8,42c56db83552d9a1,0014e7a7c317fa07] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:46:59.938 INFO 9 --- [ocp-schedules-12,63026eb24349c053,01199f3e5b475984] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:46:59.941 INFO 9 --- [ocp-schedules-15,2f77cb6bcfe94afa,25ce4ce519fe3392] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:46:59.941 INFO 9 --- [ocp-schedules-6,e9c5e755911833aa,7fabcd043af79b1f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:46:59.942 INFO 9 --- [ocp-schedules-13,524e52f380a4aa4e,aca3ac99c6561653] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:46:59.942 INFO 9 --- [ocp-schedules-15,2f77cb6bcfe94afa,25ce4ce519fe3392] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:59.942 INFO 9 --- [ocp-schedules-6,e9c5e755911833aa,7fabcd043af79b1f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:59.943 INFO 9 --- [ocp-schedules-13,524e52f380a4aa4e,aca3ac99c6561653] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:46:59.943 INFO 9 --- [ocp-schedules-13,524e52f380a4aa4e,aca3ac99c6561653] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:46:59.944 INFO 9 --- [ocp-schedules-1,7c33d650c309c2f3,1edd2e8ab3651f3a] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:46:59.944 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:46:59.944 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:46:59.944 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:46:59.944 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:46:59.944 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:46:59.944 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:46:59.944 INFO 9 --- [ocp-schedules-4,08c316f11a7eb447,3305e4f105a6929c] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:46:59.945 INFO 9 --- [ocp-schedules-12,7e49762f0d5c8bbf,6928eeef4ccbc282] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:46:59.945 INFO 9 --- [host-check-agent-status1,08c316f11a7eb447,841470cae71c2a93] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:46:59.945 INFO 9 --- [host-check-agent-status2,08c316f11a7eb447,fdcea81bc94d11a0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:46:59.945 INFO 9 --- [host-check-clockdiff1,7e49762f0d5c8bbf,6f65e2a6f51d9fe5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:46:59.945 INFO 9 --- [host-check-agent-status3,08c316f11a7eb447,83920ccf65362871] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:46:59.945 INFO 9 --- [host-check-clockdiff2,7e49762f0d5c8bbf,042f351ce59557fe] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:46:59.945 INFO 9 --- [host-check-agent-status4,08c316f11a7eb447,75101833ae046a04] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:46:59.945 INFO 9 --- [host-check-clockdiff3,7e49762f0d5c8bbf,e6ef6ba16966cd8e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:46:59.945 INFO 9 --- [host-check-agent-status5,08c316f11a7eb447,44cd964e1112e669] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:46:59.945 INFO 9 --- [host-check-clockdiff4,7e49762f0d5c8bbf,568fea86d06c547a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:46:59.945 INFO 9 --- [host-check-clockdiff5,7e49762f0d5c8bbf,292dcf4856c2c312] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:46:59.945 INFO 9 --- [host-check-agent-status6,08c316f11a7eb447,2c143fabc2de3127] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:46:59.945 INFO 9 --- [host-check-clockdiff6,7e49762f0d5c8bbf,0b74f4d1688644e3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:46:59.951 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:46:59.951 INFO 9 --- [ocp-schedules-2,81644afd212613ea,930f082afca46750] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:46:59.951 INFO 9 --- [host-check-clockdiff3,7e49762f0d5c8bbf,e6ef6ba16966cd8e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001619 -1 -1 , error= 2025-09-16 13:46:59.951 INFO 9 --- [host-check-clockdiff2,7e49762f0d5c8bbf,042f351ce59557fe] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001619 -1 -1 , error= 2025-09-16 13:46:59.951 INFO 9 --- [host-check-clockdiff1,7e49762f0d5c8bbf,6f65e2a6f51d9fe5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001619 -1 -1 , error= 2025-09-16 13:46:59.953 INFO 9 --- [host-check-agent-status3,08c316f11a7eb447,83920ccf65362871] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:46:59.953 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:46:59.953 INFO 9 --- [host-check-agent-status1,08c316f11a7eb447,841470cae71c2a93] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:46:59.953 INFO 9 --- [host-check-agent-status4,08c316f11a7eb447,75101833ae046a04] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:46:59.953 INFO 9 --- [host-check-agent-status5,08c316f11a7eb447,44cd964e1112e669] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:46:59.953 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:46:59.953 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:46:59.953 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:59.953 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:46:59.953 INFO 9 --- [host-check-agent-status6,08c316f11a7eb447,2c143fabc2de3127] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:59.953 INFO 9 --- [host-check-agent-status2,08c316f11a7eb447,fdcea81bc94d11a0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:46:59.954 INFO 9 --- [host-check-clockdiff6,7e49762f0d5c8bbf,0b74f4d1688644e3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001619 -1 -1 , error= 2025-09-16 13:46:59.954 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:46:59.955 INFO 9 --- [host-check-agent-status1,08c316f11a7eb447,841470cae71c2a93] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:46:59.955 INFO 9 --- [host-check-agent-status4,08c316f11a7eb447,75101833ae046a04] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:46:59.955 INFO 9 --- [host-check-agent-status3,08c316f11a7eb447,83920ccf65362871] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:46:59.955 INFO 9 --- [host-check-agent-status2,08c316f11a7eb447,fdcea81bc94d11a0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:46:59.955 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:46:59.955 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:46:59.955 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:46:59.955 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:46:59.955 INFO 9 --- [host-check-agent-status5,08c316f11a7eb447,44cd964e1112e669] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:46:59.955 INFO 9 --- [host-check-agent-status6,08c316f11a7eb447,2c143fabc2de3127] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:59.955 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:59.970 INFO 9 --- [host-check-agent-status2,08c316f11a7eb447,fdcea81bc94d11a0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:46:59.970 INFO 9 --- [host-check-agent-status6,08c316f11a7eb447,2c143fabc2de3127] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:46:59.970 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:46:59.970 INFO 9 --- [host-check-agent-status3,08c316f11a7eb447,83920ccf65362871] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:46:59.970 INFO 9 --- [host-check-agent-status4,08c316f11a7eb447,75101833ae046a04] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:46:59.971 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:46:59.971 INFO 9 --- [host-check-agent-status1,08c316f11a7eb447,841470cae71c2a93] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:46:59.971 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:46:59.971 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:46:59.972 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:46:59.972 INFO 9 --- [host-check-agent-status5,08c316f11a7eb447,44cd964e1112e669] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:46:59.972 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:46:59.971466545+08:00 2025-09-16 13:46:59.972 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:46:59.971269322+08:00 2025-09-16 13:46:59.972 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:46:59.971492851+08:00 2025-09-16 13:46:59.972 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:46:59.972+08:00 2025-09-16 13:46:59.972 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:46:59.973 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:46:59.972151190+08:00 2025-09-16 13:46:59.973 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:46:59.972+08:00 2025-09-16 13:46:59.973 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:46:59.972+08:00 2025-09-16 13:46:59.973 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:46:59.973+08:00 2025-09-16 13:46:59.973 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:46:59.972520492+08:00 2025-09-16 13:46:59.974 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:46:59.973+08:00 2025-09-16 13:46:59.974 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:46:59.973260030+08:00 2025-09-16 13:46:59.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:59.974 INFO 9 --- [host-check-agent-status2,08c316f11a7eb447,fdcea81bc94d11a0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:46:59.974 INFO 9 --- [host-check-agent-status2,08c316f11a7eb447,fdcea81bc94d11a0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:46:59.974 INFO 9 --- [host-check-agent-status2,08c316f11a7eb447,fdcea81bc94d11a0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:46:59.975 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:46:59.974+08:00 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status1,08c316f11a7eb447,841470cae71c2a93] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status1,08c316f11a7eb447,841470cae71c2a93] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status3,08c316f11a7eb447,83920ccf65362871] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status3,08c316f11a7eb447,83920ccf65362871] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status1,08c316f11a7eb447,841470cae71c2a93] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status3,08c316f11a7eb447,83920ccf65362871] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status4,08c316f11a7eb447,75101833ae046a04] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status4,08c316f11a7eb447,75101833ae046a04] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status4,08c316f11a7eb447,75101833ae046a04] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status6,08c316f11a7eb447,2c143fabc2de3127] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status6,08c316f11a7eb447,2c143fabc2de3127] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:46:59.975 INFO 9 --- [host-check-agent-status6,08c316f11a7eb447,2c143fabc2de3127] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:46:59.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:46:59.976 INFO 9 --- [host-check-agent-status5,08c316f11a7eb447,44cd964e1112e669] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:46:59.976 INFO 9 --- [host-check-agent-status5,08c316f11a7eb447,44cd964e1112e669] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:46:59.976 INFO 9 --- [host-check-agent-status5,08c316f11a7eb447,44cd964e1112e669] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:46:59.978 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:46:59.972+08:00 and status AVAILABLE 2025-09-16 13:46:59.980 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:46:59.974+08:00 and status AVAILABLE 2025-09-16 13:46:59.980 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:46:59.980 INFO 9 --- [ocp-schedules-6,e9c5e755911833aa,7fabcd043af79b1f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:46:59.980 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:46:59.972+08:00 and status AVAILABLE 2025-09-16 13:46:59.982 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:46:59.982 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:46:59.973+08:00 and status AVAILABLE 2025-09-16 13:46:59.983 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:46:59.972+08:00 and status AVAILABLE 2025-09-16 13:46:59.983 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:46:59.983 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:46:59.984 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:46:59.984 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:46:59.973+08:00 and status AVAILABLE 2025-09-16 13:46:59.986 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:46:59.986 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:46:59.988 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:46:59.988 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:46:59.989 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:46:59.989 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:46:59.989 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:46:59.990 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:46:59.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:46:59.990 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:46:59.990 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:46:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:46:59.992 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:46:59.992 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:46:59.993 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:46:59.993 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:47:00.003 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:00.004 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:00.004 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:00.005 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:47:00.004428+08:00, lastProcessTime=2025-09-16T13:46:50.002786+08:00 2025-09-16 13:47:00.006 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:00.007 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:00.031 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:47:00.031 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:47:00.031 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:47:00.032 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:00.033 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:47:00.034 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:47:00.035 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:47:00.036 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:00.037 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:47:00.038 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:47:00.038 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:47:00.038 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:47:00.040 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:47:00.041 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:47:00.041 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:47:00.055 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:00.056 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:00.056 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:00.057 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:00.059 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:00.060 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:00.072 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:00.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:00.075 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:47:00.081 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:00.083 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:47:00.084 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:47:00.084 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:47:00.084 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:00.086 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:47:00.088 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:47:00.088 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:47:00.090 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:47:00.091 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:47:00.091 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:47:00.093 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:47:00.094 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:47:00.095 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:47:00.096 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:47:00.102 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.102 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:00.103 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:00.103 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:00.104 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:00.105 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:00.107 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:00.107 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:00.122 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.122 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:00.130 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:47:00.131 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:47:00.131 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:47:00.133 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:47:00.135 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:47:00.135 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:47:00.004428+08:00 2025-09-16 13:47:00.135 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:47:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:00.137 INFO 9 --- [host-check-host-status5,7c33d650c309c2f3,72baa8b2216e9e7e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:47:00.137 INFO 9 --- [host-check-host-status2,7c33d650c309c2f3,cff48f027bda5a85] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:47:00.137 INFO 9 --- [host-check-host-status1,7c33d650c309c2f3,9962681abd44c7a0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:47:00.140 INFO 9 --- [host-check-host-status4,7c33d650c309c2f3,60c08fdde9129d23] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:47:00.141 INFO 9 --- [host-check-host-status3,7c33d650c309c2f3,c1054e61eb8d7258] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:47:00.142 INFO 9 --- [host-check-host-status6,7c33d650c309c2f3,ee6cfe30ec8082fc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:47:00.151 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.151 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:00.178 INFO 9 --- [ocp-async-7,cfcc92f1d25e3e99,2af158996543b0f9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:47:00.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:00.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:00.222 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.222 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:00.237 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:00.250 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:00.252 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:00.253 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:47:00.258 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:47:00.261 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:47:00.264 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:00.265 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:00.278 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:47:00.345 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:47:00.359 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:00.363 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:00.364 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:47:00.378 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:47:00.378 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001042801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:47:00.378 INFO 9 --- [ocp-schedules-15,2f77cb6bcfe94afa,25ce4ce519fe3392] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:47:00.411 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:00.411 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:00.765 WARN 9 --- [ocp-async-9,fd12fb18e7f932f3,9b2cc18ded6fb380] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:00.765 INFO 9 --- [ocp-async-1,6704cd481ecf8186,f5fe98cddc4595a8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:00.815 INFO 9 --- [ocp-schedules-18,9aa84fa0c398b16e,1c2bc7fdff3c05e8] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:47:00.888 INFO 9 --- [host-check-clockdiff5,7e49762f0d5c8bbf,292dcf4856c2c312] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001620 -1 -1 , error= 2025-09-16 13:47:00.889 INFO 9 --- [host-check-clockdiff4,7e49762f0d5c8bbf,568fea86d06c547a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001620 -1 -1 , error= 2025-09-16 13:47:01.636 INFO 9 --- [prometheus-minute-schedule-1,c54b318e8b97e924,c85f5d51121fd3ba] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:01.639 INFO 9 --- [prometheus-minute-schedule-1,c54b318e8b97e924,c85f5d51121fd3ba] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:02.765 WARN 9 --- [ocp-async-4,7c86b3afaf6ac5a8,4f2dcef8069783a4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:02.765 INFO 9 --- [ocp-async-8,7c297d2a98286e15,d64e79f52c6a22bf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:03.411 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:03.412 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:04.616 INFO 9 --- [ocp-schedules-21,dd2f02a46524bc8e,bbd7f92e0e5a0f82] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:47:04.636 INFO 9 --- [prometheus-minute-schedule-1,42d584bcc7468259,4017c19b7fc27fe2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:04.639 INFO 9 --- [prometheus-minute-schedule-1,42d584bcc7468259,4017c19b7fc27fe2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:04.765 WARN 9 --- [ocp-async-2,de567648957b9422,75395c3495b8c807] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:04.765 INFO 9 --- [ocp-async-5,82366b6f69baf508,18f0a65e01d55509] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:06.412 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:06.412 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:06.765 WARN 9 --- [ocp-async-3,8c28533dc6f0b7c0,a818f2ef8283476b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:06.765 INFO 9 --- [ocp-async-9,6df2f342c08de1c6,b1338d4dea55141b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:07.636 INFO 9 --- [prometheus-minute-schedule-1,07ab05bb67a2fb81,e631605cd18eb49c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:07.640 INFO 9 --- [prometheus-minute-schedule-1,07ab05bb67a2fb81,e631605cd18eb49c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:08.765 INFO 9 --- [ocp-schedules-7,16352100f6a3f820,065a298e6ffbf18f] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:47:08.765 INFO 9 --- [ocp-async-1,132d3e5f9712e996,5a58987b3cecbb17] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:08.765 WARN 9 --- [ocp-async-7,e1b0207023fbc405,bf1bd2e42bf0716c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:08.768 INFO 9 --- [ocp-schedules-7,16352100f6a3f820,065a298e6ffbf18f] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:47:09.413 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:09.413 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:09.781 INFO 9 --- [ocp-schedules-13,79e7dd067633ccad,5ac2991ac8b6ff81] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:47:09.786 WARN 9 --- [scanner-1362976-1,79e7dd067633ccad,c95e43611a1219da] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:47:10.002 INFO 9 --- [ocp-schedules-20,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:47:10.002 INFO 9 --- [ocp-schedules-16,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:47:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:47:10.003661+08:00, lastProcessTime=2025-09-16T13:47:00.004428+08:00 2025-09-16 13:47:10.112 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:47:10.003661+08:00 2025-09-16 13:47:10.178 INFO 9 --- [ocp-async-3,ed258e00d92e3bf1,cc60f02e6b674dc6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:47:10.298 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:47:10.636 INFO 9 --- [prometheus-minute-schedule-1,a2de23653c0aea22,d78dfd9bfd040a95] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:10.639 INFO 9 --- [prometheus-minute-schedule-1,a2de23653c0aea22,d78dfd9bfd040a95] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:10.765 INFO 9 --- [ocp-async-2,75fbe6c4704ff59b,6b5d7f69a8e34a93] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:10.766 WARN 9 --- [ocp-async-5,ab69e8a10f87c3ba,6e9207183fdc866c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:11.694 INFO 9 --- [metric-archive-async-1,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001560, nodeCount=463, affectRows=463 2025-09-16 13:47:12.413 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:12.414 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:12.766 INFO 9 --- [ocp-async-3,e1e7a2284a2259f3,4b08eac7dccdb0f6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:12.766 WARN 9 --- [ocp-async-9,3186eb19f845540d,82b965176a91416e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:13.636 INFO 9 --- [prometheus-minute-schedule-1,605f23c35b8eabe4,88da5aeb6d818202] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:13.640 INFO 9 --- [prometheus-minute-schedule-1,605f23c35b8eabe4,88da5aeb6d818202] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:14.498 INFO 9 --- [ocp-schedules-24,467a0a228baad23a,5dc3b2c65f086629] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:47:14.503 INFO 9 --- [ocp-schedules-24,467a0a228baad23a,5dc3b2c65f086629] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:47:14.503 INFO 9 --- [ocp-schedules-24,467a0a228baad23a,5dc3b2c65f086629] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:47:14.620 INFO 9 --- [ocp-schedules-20,6fe279ccec296a0b,245cfc213df019c8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:47:14.766 INFO 9 --- [ocp-async-7,b093bfc61f2bfd52,bed779d16e2b6ae7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:14.766 WARN 9 --- [ocp-async-1,8d4327e321a73eff,84ae0a7bc7ac0445] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:14.965 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001560, nodeCount=1000, affectRows=1000 2025-09-16 13:47:14.968 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001560, nodeCount=1000, validCount=996 2025-09-16 13:47:14.992 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001560, nodeCount=1000, affectRows=1000 2025-09-16 13:47:14.995 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001560, nodeCount=1000, validCount=998 2025-09-16 13:47:15.006 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952465403904-1758001500' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952465403904-1758001500' for key 'PRIMARY' 2025-09-16 13:47:15.414 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:15.414 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:15.421 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001560, nodeCount=238, affectRows=238 2025-09-16 13:47:15.421 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001560, nodeCount=238, validCount=237 2025-09-16 13:47:15.423 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001560, nodeCount=308, affectRows=308 2025-09-16 13:47:15.423 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001560, nodeCount=307, affectRows=307 2025-09-16 13:47:15.423 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001560, nodeCount=308, validCount=306 2025-09-16 13:47:15.423 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001560, nodeCount=307, validCount=307 2025-09-16 13:47:16.303 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001560, nodeCount=1000, affectRows=1000 2025-09-16 13:47:16.305 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001560, nodeCount=992, validCount=947 2025-09-16 13:47:16.636 INFO 9 --- [prometheus-minute-schedule-1,0b359a6d78736731,60403a2e03cda669] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:16.639 INFO 9 --- [prometheus-minute-schedule-1,0b359a6d78736731,60403a2e03cda669] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:16.766 INFO 9 --- [ocp-async-8,6927e26c9ee4030c,04590f8f433fbf2b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:16.766 WARN 9 --- [ocp-async-6,fdb1874704fb6eb4,6ea505cc626e3ac0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:18.415 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:18.415 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:18.766 INFO 9 --- [ocp-async-2,30555471e2f70ea0,7b6fed85d3966eb8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:18.766 WARN 9 --- [ocp-async-10,708a57cc52375cde,a8a4440eae2c029d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:18.772 INFO 9 --- [ocp-schedules-4,61f0066faf20825f,f0efc99d28c524c3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:47:18.774 INFO 9 --- [ocp-schedules-4,61f0066faf20825f,f0efc99d28c524c3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:47:18.848 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,835bf348e5996fd7,6f2d9cbaeaef633f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=835bf348e5996fd7, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:47:18.848 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,835bf348e5996fd7,6f2d9cbaeaef633f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=835bf348e5996fd7, duration=2 ms] 2025-09-16 13:47:19.636 INFO 9 --- [prometheus-minute-schedule-1,88d1be6616ba0fd4,491f356ad2bf0c37] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:19.640 INFO 9 --- [prometheus-minute-schedule-1,88d1be6616ba0fd4,491f356ad2bf0c37] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:19.809 INFO 9 --- [ocp-schedules-15,866c1d125c6b7936,ae35771e5fa98c2e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:47:19.814 WARN 9 --- [scanner-1363972-1,866c1d125c6b7936,289217d310981bc5] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:47:19.824 INFO 9 --- [alarm-detect-9,866c1d125c6b7936,983b4b9be45a3040] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:47:19.826 INFO 9 --- [alarm-detect-7,866c1d125c6b7936,8bc841cd0722f084] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:47:19.826 INFO 9 --- [alarm-detect-4,866c1d125c6b7936,802a2f1630f43c76] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:47:19.839 INFO 9 --- [alarm-detect-3,866c1d125c6b7936,5a659c862cf4b932] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:47:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:47:20.003061+08:00, lastProcessTime=2025-09-16T13:47:10.003661+08:00 2025-09-16 13:47:20.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:47:20.003061+08:00 2025-09-16 13:47:20.178 INFO 9 --- [ocp-async-6,6f0c8f4c55d5a5b8,0fb37ce94e4724ad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:47:20.636 INFO 9 --- [prometheus-cache-monitor1,07b90897c3d7c041,a46b0aadb3d008a7] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:47:20.636 INFO 9 --- [prometheus-cache-monitor1,07b90897c3d7c041,a46b0aadb3d008a7] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:47:20.766 INFO 9 --- [ocp-async-1,f7b75ac0cf35a0ff,a7dfbb29e78a4e9b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:20.766 WARN 9 --- [ocp-async-7,c6afff88f8498306,4788cf402d738008] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:21.415 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:21.416 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:22.636 INFO 9 --- [prometheus-minute-schedule-1,c4c28db08c6d3bea,c9e0fdb632f28284] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:22.639 INFO 9 --- [prometheus-minute-schedule-1,c4c28db08c6d3bea,c9e0fdb632f28284] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:22.766 INFO 9 --- [ocp-async-6,7793c21d0ba49dc1,6f9bbde62f9e58ae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:22.766 WARN 9 --- [ocp-async-8,325ae0b55be5f25a,39ecefb5c5383fa5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:22.801 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ada89637bc215386,a725b13842c0e9f4] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=zhengqi&version=2&ObClusterId=1, client=10.232.140.0, traceId=ada89637bc215386, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(String,Long,String,Long,Integer,String), args=zhengqi,1,2,{"ObRegion":"zhengqi","ObCluster":"zhengqi","ObRegionId":1,"ObClusterId":1,"Type":"PRIMARY","timestamp":1758001642797471,"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},] 2025-09-16 13:47:22.810 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ada89637bc215386,a725b13842c0e9f4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Put cluster info ClusterCacheInfo(clusterName=zhengqi, obClusterId=1, rootServerJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, groupName=zhengqi, obproxyClusters=null, tenantInfos=[]) into config server cache 2025-09-16 13:47:22.810 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ada89637bc215386,a725b13842c0e9f4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Put cluster info into config server cache success 2025-09-16 13:47:22.810 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ada89637bc215386,a725b13842c0e9f4] c.o.ocp.configurl.ConfigUrlService : updateRootServer, clusterName=zhengqi, clusterId=1, affectRows=1 2025-09-16 13:47:22.811 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ada89637bc215386,a725b13842c0e9f4] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /services client=10.232.140.0, traceId=ada89637bc215386, duration=11 ms] 2025-09-16 13:47:24.416 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:24.416 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:24.624 INFO 9 --- [ocp-schedules-3,241c332431222801,6e94e64e5f2cbcb9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:47:24.766 INFO 9 --- [ocp-async-10,4724f79841c305b0,ad6ccedb35af70f9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:24.766 WARN 9 --- [ocp-async-2,b724a361a534c376,f380cd8e2b1d3aef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:25.636 INFO 9 --- [prometheus-minute-schedule-1,576c02b453861c8a,f7790b1a229f60d8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:25.639 INFO 9 --- [prometheus-minute-schedule-1,576c02b453861c8a,f7790b1a229f60d8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:26.766 WARN 9 --- [ocp-async-4,e418cd946d37e278,f87c118ecb0d2964] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:26.766 INFO 9 --- [ocp-async-7,f8e53f265b437dd6,c8d7fb6bdcb25166] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:27.416 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:27.417 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:28.636 INFO 9 --- [prometheus-minute-schedule-1,405c98b789b4d5eb,f3ca251bcd62587e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:28.639 INFO 9 --- [prometheus-minute-schedule-1,405c98b789b4d5eb,f3ca251bcd62587e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:28.767 INFO 9 --- [ocp-async-1,8a1ce7736831bce8,38e7f838cbf88eff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:28.767 WARN 9 --- [ocp-async-5,7eb800af99582286,f7ffc801df33fb60] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:28.778 INFO 9 --- [ocp-schedules-9,b6cbf52e44ee8744,351def5b9d64fe2e] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:47:28.780 INFO 9 --- [ocp-schedules-9,b6cbf52e44ee8744,351def5b9d64fe2e] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:47:29.841 INFO 9 --- [ocp-schedules-16,a5be493c551386e1,11153d69dea9ed74] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:47:29.846 WARN 9 --- [scanner-1364136-1,a5be493c551386e1,5b2a7ef8b98ffb41] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:47:29.938 INFO 9 --- [ocp-schedules-28,eae98afce1e19686,ee687db749fd7ef4] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:47:29.941 INFO 9 --- [ocp-schedules-7,9088908935b68079,2f5eca63c48080ce] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:47:29.941 INFO 9 --- [ocp-schedules-4,6402b1987eda9cc8,5a41e2e66ff51cbf] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:47:29.942 INFO 9 --- [ocp-schedules-24,b5f1861d3a8f5226,e32f52f5e2fad2de] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:47:29.942 INFO 9 --- [ocp-schedules-7,9088908935b68079,2f5eca63c48080ce] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:29.942 INFO 9 --- [ocp-schedules-4,6402b1987eda9cc8,5a41e2e66ff51cbf] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:29.943 INFO 9 --- [ocp-schedules-24,b5f1861d3a8f5226,e32f52f5e2fad2de] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:29.943 INFO 9 --- [ocp-schedules-24,b5f1861d3a8f5226,e32f52f5e2fad2de] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:47:29.944 INFO 9 --- [ocp-schedules-21,5c3852c0b66fcd35,06cbc1bf42bf54c1] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:47:29.944 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:47:29.944 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:47:29.944 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:47:29.944 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:47:29.944 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:47:29.944 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:47:29.945 INFO 9 --- [ocp-schedules-19,67f9e94b0c2c2c54,3ae1947a5a3dba15] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:47:29.945 INFO 9 --- [host-check-agent-status1,67f9e94b0c2c2c54,412b9e2b4f63987e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:47:29.945 INFO 9 --- [host-check-agent-status2,67f9e94b0c2c2c54,00b52c2d4c081463] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:47:29.945 INFO 9 --- [ocp-schedules-28,4198f98912724361,b206a4aec367cd05] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:47:29.945 INFO 9 --- [host-check-agent-status3,67f9e94b0c2c2c54,25b9e6c0142da82b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:47:29.945 INFO 9 --- [host-check-agent-status4,67f9e94b0c2c2c54,e6dbc9907bd11ddf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:47:29.945 INFO 9 --- [host-check-agent-status5,67f9e94b0c2c2c54,b9f621d8740bbad7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:47:29.945 INFO 9 --- [host-check-agent-status6,67f9e94b0c2c2c54,c3b3c02aec9607c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:47:29.945 INFO 9 --- [host-check-clockdiff1,4198f98912724361,d8e29ca8f3434181] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:47:29.946 INFO 9 --- [host-check-clockdiff2,4198f98912724361,b0507aeef273efc5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:47:29.946 INFO 9 --- [host-check-clockdiff3,4198f98912724361,cd499b92560499b9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:47:29.946 INFO 9 --- [host-check-clockdiff4,4198f98912724361,468b48e0c7979c67] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:47:29.946 INFO 9 --- [host-check-clockdiff5,4198f98912724361,5eb5189880182c13] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:47:29.946 INFO 9 --- [host-check-clockdiff6,4198f98912724361,3c8e8f9ba1c8e145] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:47:29.951 INFO 9 --- [ocp-schedules-5,5f88164bffeb3408,b1fc30dabe3c426a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:47:29.951 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:29.951 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:47:29.951 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:47:29.951 INFO 9 --- [host-check-clockdiff5,4198f98912724361,5eb5189880182c13] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001649 -1 -1 , error= 2025-09-16 13:47:29.954 INFO 9 --- [host-check-agent-status1,67f9e94b0c2c2c54,412b9e2b4f63987e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:47:29.954 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:47:29.954 INFO 9 --- [host-check-clockdiff2,4198f98912724361,b0507aeef273efc5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001649 -1 -1 , error= 2025-09-16 13:47:29.954 INFO 9 --- [host-check-clockdiff1,4198f98912724361,d8e29ca8f3434181] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001649 -1 -1 , error= 2025-09-16 13:47:29.954 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:47:29.955 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:47:29.956 INFO 9 --- [host-check-clockdiff6,4198f98912724361,3c8e8f9ba1c8e145] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001649 -1 -1 , error= 2025-09-16 13:47:29.958 INFO 9 --- [host-check-agent-status2,67f9e94b0c2c2c54,00b52c2d4c081463] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:47:29.958 INFO 9 --- [host-check-agent-status6,67f9e94b0c2c2c54,c3b3c02aec9607c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:29.958 INFO 9 --- [host-check-agent-status4,67f9e94b0c2c2c54,e6dbc9907bd11ddf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:47:29.958 INFO 9 --- [host-check-agent-status5,67f9e94b0c2c2c54,b9f621d8740bbad7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:47:29.958 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:47:29.958 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:47:29.958 INFO 9 --- [host-check-agent-status1,67f9e94b0c2c2c54,412b9e2b4f63987e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:47:29.958 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:47:29.958 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:29.958 INFO 9 --- [host-check-clockdiff3,4198f98912724361,cd499b92560499b9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001649 -1 -1 , error= 2025-09-16 13:47:29.958 INFO 9 --- [host-check-clockdiff4,4198f98912724361,468b48e0c7979c67] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001649 -1 -1 , error= 2025-09-16 13:47:29.958 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:47:29.958 INFO 9 --- [host-check-agent-status3,67f9e94b0c2c2c54,25b9e6c0142da82b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:47:29.959 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:47:29.959 INFO 9 --- [host-check-agent-status6,67f9e94b0c2c2c54,c3b3c02aec9607c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:29.959 INFO 9 --- [host-check-agent-status2,67f9e94b0c2c2c54,00b52c2d4c081463] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:47:29.959 INFO 9 --- [host-check-agent-status4,67f9e94b0c2c2c54,e6dbc9907bd11ddf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:47:29.959 INFO 9 --- [host-check-agent-status5,67f9e94b0c2c2c54,b9f621d8740bbad7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:47:29.959 INFO 9 --- [host-check-agent-status3,67f9e94b0c2c2c54,25b9e6c0142da82b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:47:29.962 INFO 9 --- [ocp-schedules-26,310103d4322b4e89,90bc73e6cebb7d17] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:47:29.963 INFO 9 --- [ocp-schedules-9,9c5783f58baf6f3a,a9a8876ee7bcebd2] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:47:29.968 INFO 9 --- [ocp-schedules-26,310103d4322b4e89,90bc73e6cebb7d17] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:47:29.970 INFO 9 --- [ocp-schedules-9,9c5783f58baf6f3a,a9a8876ee7bcebd2] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:47:29.973 INFO 9 --- [host-check-agent-status4,67f9e94b0c2c2c54,e6dbc9907bd11ddf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-agent-status1,67f9e94b0c2c2c54,412b9e2b4f63987e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-agent-status2,67f9e94b0c2c2c54,00b52c2d4c081463] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-agent-status5,67f9e94b0c2c2c54,b9f621d8740bbad7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:47:29.974 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:47:29.975 INFO 9 --- [host-check-agent-status3,67f9e94b0c2c2c54,25b9e6c0142da82b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:47:29.975 INFO 9 --- [host-check-agent-status6,67f9e94b0c2c2c54,c3b3c02aec9607c6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:47:29.975 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:47:29.974412919+08:00 2025-09-16 13:47:29.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:29.975 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:47:29.974711167+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:47:29.975182091+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:47:29.975+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:47:29.974890434+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:47:29.976+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:47:29.975185119+08:00 2025-09-16 13:47:29.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:47:29.975639526+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:47:29.976+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:47:29.976+08:00 2025-09-16 13:47:29.976 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:47:29.976+08:00 2025-09-16 13:47:29.977 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:47:29.976+08:00 2025-09-16 13:47:29.978 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:47:29.975+08:00 and status AVAILABLE 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status1,67f9e94b0c2c2c54,412b9e2b4f63987e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status1,67f9e94b0c2c2c54,412b9e2b4f63987e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status1,67f9e94b0c2c2c54,412b9e2b4f63987e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:47:29.978 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:47:29.976+08:00 and status AVAILABLE 2025-09-16 13:47:29.978 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:47:29.976+08:00 and status AVAILABLE 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status2,67f9e94b0c2c2c54,00b52c2d4c081463] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status4,67f9e94b0c2c2c54,e6dbc9907bd11ddf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status4,67f9e94b0c2c2c54,e6dbc9907bd11ddf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status4,67f9e94b0c2c2c54,e6dbc9907bd11ddf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status2,67f9e94b0c2c2c54,00b52c2d4c081463] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status3,67f9e94b0c2c2c54,25b9e6c0142da82b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status2,67f9e94b0c2c2c54,00b52c2d4c081463] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:47:29.978 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:47:29.976+08:00 and status AVAILABLE 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status3,67f9e94b0c2c2c54,25b9e6c0142da82b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status3,67f9e94b0c2c2c54,25b9e6c0142da82b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status5,67f9e94b0c2c2c54,b9f621d8740bbad7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status5,67f9e94b0c2c2c54,b9f621d8740bbad7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status5,67f9e94b0c2c2c54,b9f621d8740bbad7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status6,67f9e94b0c2c2c54,c3b3c02aec9607c6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status6,67f9e94b0c2c2c54,c3b3c02aec9607c6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:47:29.978 INFO 9 --- [host-check-agent-status6,67f9e94b0c2c2c54,c3b3c02aec9607c6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:47:29.978 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:47:29.976+08:00 and status AVAILABLE 2025-09-16 13:47:29.978 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:47:29.976+08:00 and status AVAILABLE 2025-09-16 13:47:29.981 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:47:29.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:47:29.981 INFO 9 --- [ocp-schedules-4,6402b1987eda9cc8,5a41e2e66ff51cbf] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:47:29.982 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:47:29.982 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:47:29.982 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:47:29.982 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:47:29.982 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:47:29.986 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:47:29.987 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:47:29.988 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:47:29.988 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:47:29.988 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:47:29.988 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:47:29.988 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:29.989 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:47:29.989 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:47:29.989 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:47:29.989 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:47:29.989 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:29.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:47:30.001 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:30.002 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:30.003 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:30.003 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:30.004 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:30.005 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:47:30.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:47:30.005718+08:00, lastProcessTime=2025-09-16T13:47:20.003061+08:00 2025-09-16 13:47:30.028 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:47:30.032 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:47:30.033 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:30.033 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:47:30.034 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:47:30.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:30.035 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:47:30.035 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:47:30.035 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:47:30.039 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:47:30.039 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:47:30.040 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:47:30.041 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:47:30.042 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:47:30.045 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:47:30.047 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:30.052 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:30.052 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:30.052 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:30.054 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:30.056 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:47:30.069 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:30.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:47:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:30.075 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:47:30.076 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:47:30.078 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:30.079 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:47:30.081 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:47:30.081 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:47:30.081 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:47:30.082 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:47:30.085 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:47:30.086 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:47:30.088 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:47:30.088 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:47:30.088 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:47:30.091 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:47:30.093 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.093 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:30.094 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:30.098 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:30.099 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:30.100 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:30.100 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:30.101 INFO 9 --- [prometheus-second-schedule-1,1d4e0bc998a5a99e,8f85f620e9406a5b] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:47:30.102 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:47:30.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:30.123 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:30.125 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:47:30.125 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:47:30.126 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:47:30.128 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:47:30.131 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:47:30.131 INFO 9 --- [host-check-host-status1,5c3852c0b66fcd35,c7e51cd5dd7aef8a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:47:30.132 INFO 9 --- [host-check-host-status4,5c3852c0b66fcd35,b159b35255658088] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:47:30.134 INFO 9 --- [host-check-host-status2,5c3852c0b66fcd35,cee2228e8136f498] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:47:30.135 INFO 9 --- [host-check-host-status5,5c3852c0b66fcd35,b8fee01a216055ae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:47:30.135 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:47:30.005718+08:00 2025-09-16 13:47:30.136 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:47:30.138 INFO 9 --- [host-check-host-status3,5c3852c0b66fcd35,4479041432311b60] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:47:30.141 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.141 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:30.142 INFO 9 --- [host-check-host-status6,5c3852c0b66fcd35,e821714d2e9a93c4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:47:30.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:30.170 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.170 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:30.178 INFO 9 --- [ocp-async-7,58eb34cd5820f68e,8b5809baac1505fa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:47:30.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.185 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:30.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:47:30.215 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.215 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:47:30.230 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:47:30.244 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:30.246 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:30.247 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:47:30.252 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:47:30.255 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:47:30.258 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:30.259 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:30.262 INFO 9 --- [ocp-schedules-2,61035b70dc001056,6469061062a77daf] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:47:30.263 INFO 9 --- [ocp-schedules-2,61035b70dc001056,6469061062a77daf] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:30.264 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:47:30.264 INFO 9 --- [ocp-schedules-2,61035b70dc001056,6469061062a77daf] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:47:30.272 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:47:30.333 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:47:30.346 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:30.347 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:30.348 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:47:30.363 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:47:30.363 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:47:30.363 INFO 9 --- [ocp-schedules-7,9088908935b68079,2f5eca63c48080ce] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:47:30.388 INFO 9 --- [ocp-schedules-18,9c2799068195fa2d,03cbf69d020c5b29] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:47:30.417 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:30.418 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:30.563 INFO 9 --- [ocp-schedules-30,3c0aa60000dc52e5,3fe31a752bc56e3c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:47:30.565 INFO 9 --- [ocp-schedules-30,3c0aa60000dc52e5,3fe31a752bc56e3c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:47:30.565 INFO 9 --- [ocp-schedules-30,3c0aa60000dc52e5,3fe31a752bc56e3c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:47:30.767 INFO 9 --- [ocp-async-4,17f9fb0e9acd8f6c,2cbbec07eae1356f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:30.767 WARN 9 --- [ocp-async-3,c51c770e3e19eecc,093be3e964380c70] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:30.817 INFO 9 --- [ocp-schedules-19,3db8cc9db8485747,02501f5d70f5ea50] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:47:30.953 INFO 9 --- [ocp-schedules-14,78f6a542c2f7bb9d,d4bb2f5bf005bdb3] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:47:30.953 INFO 9 --- [ocp-schedules-14,78f6a542c2f7bb9d,d4bb2f5bf005bdb3] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:47:31.421 INFO 9 --- [ocp-schedules-22,eee9387a10c3b100,c70e22e59cf921f7] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:47:31.421 INFO 9 --- [ocp-schedules-22,eee9387a10c3b100,c70e22e59cf921f7] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001651 2025-09-16 13:47:31.424 INFO 9 --- [ocp-schedules-22,eee9387a10c3b100,c70e22e59cf921f7] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:47:31.592 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2025-09-16 13:47:31.592 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2025-09-16 13:47:31.595 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2025-09-16 13:47:31.595 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: binlogQueryCache 2025-09-16 13:47:31.595 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.c.cache.helper.BinlogQueryCache : Init binlog cache. 2025-09-16 13:47:31.598 INFO 9 --- [ocp-schedules-7,9e34ad62c292874b,e74e52c7d20f0e10] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:47:31.600 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.c.cache.helper.BinlogQueryCache : Finish init binlog cache. 2025-09-16 13:47:31.600 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2025-09-16 13:47:31.600 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2025-09-16 13:47:31.607 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2025-09-16 13:47:31.607 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2025-09-16 13:47:31.607 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2025-09-16 13:47:31.610 INFO 9 --- [ocp-schedules-15,375ee5c1baa2bdaf,7d8f526fcff8b311] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2025-09-16 13:47:31.636 INFO 9 --- [prometheus-minute-schedule-1,65577e1ff9a21606,f598290f46c59c06] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:31.639 INFO 9 --- [prometheus-minute-schedule-1,65577e1ff9a21606,f598290f46c59c06] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:31.650 INFO 9 --- [ocp-schedules-18,59b0c8e159e12399,9bc5919842bf7cda] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:47:31.668 INFO 9 --- [ocp-schedules-16,2324d6597edfebc1,daefb1952c142845] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:47:31.668 INFO 9 --- [ocp-schedules-16,2324d6597edfebc1,daefb1952c142845] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:47:31.671 INFO 9 --- [ocp-schedules-16,2324d6597edfebc1,daefb1952c142845] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:47:31.671 INFO 9 --- [ocp-schedules-16,2324d6597edfebc1,daefb1952c142845] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:47:31.674 INFO 9 --- [ocp-schedules-16,2324d6597edfebc1,daefb1952c142845] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:47:31.674 INFO 9 --- [ocp-schedules-16,2324d6597edfebc1,daefb1952c142845] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:47:32.767 INFO 9 --- [ocp-async-7,1e974f073c05487e,f6fde9367d87a251] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:32.767 WARN 9 --- [ocp-async-8,d5a98df7f2d367be,3429d679d5f683fa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:33.319 INFO 9 --- [ocp-schedules-28,d0fc06a5f1c43585,42746b1e2dce27f4] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:47:33.418 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:33.418 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:33.445 INFO 9 --- [ocp-schedules-24,2856b71e0ad8755f,0a9b3f95c2d36bb3] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:47:33.445+08:00, clusters=[1] 2025-09-16 13:47:33.446 INFO 9 --- [ocp-schedules-24,2856b71e0ad8755f,0a9b3f95c2d36bb3] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:47:34.001 INFO 9 --- [ocp-schedules-4,1b8e68fe31977218,bd35584f52afffd0] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:47:34.001 INFO 9 --- [ocp-schedules-4,1b8e68fe31977218,bd35584f52afffd0] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:47:34.004 INFO 9 --- [ocp-schedules-4,1b8e68fe31977218,bd35584f52afffd0] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:47:34.019 INFO 9 --- [ocp-schedules-4,1b8e68fe31977218,bd35584f52afffd0] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:47:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:47:34.505 INFO 9 --- [ocp-schedules-16,e180a3876f1d51b7,723c49293a80b517] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:47:34.510 INFO 9 --- [ocp-schedules-16,e180a3876f1d51b7,723c49293a80b517] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:47:34.510 INFO 9 --- [ocp-schedules-16,e180a3876f1d51b7,723c49293a80b517] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:47:34.627 INFO 9 --- [ocp-schedules-9,09af87b23fa5e952,ec75d31751e85065] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:47:34.636 INFO 9 --- [prometheus-minute-schedule-1,cd8a4a9e129cd0e3,140993fd7cb61041] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:34.639 INFO 9 --- [prometheus-minute-schedule-1,cd8a4a9e129cd0e3,140993fd7cb61041] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:34.767 WARN 9 --- [ocp-async-6,5aadb41dfa44bddb,4c1269cb2cfd6f36] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:34.767 INFO 9 --- [ocp-async-1,430db8f4889cf448,562ba6d17c196f77] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:35.478 INFO 9 --- [ocp-schedules-1,2837f24cb309db5f,35600b3ecf48af33] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:47:35.478+08:00, clusters=[1] 2025-09-16 13:47:35.481 INFO 9 --- [ocp-schedules-1,2837f24cb309db5f,35600b3ecf48af33] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:47:36.418 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:36.419 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:36.767 WARN 9 --- [ocp-async-3,dafd0d7de568363f,84c73878f702f064] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:36.767 INFO 9 --- [ocp-async-10,f4e8886f62f78db4,9d67404d3502fe82] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:37.558 INFO 9 --- [ocp-schedules-25,b715486e5c4e3f1e,21433d2d00b88a37] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:47:37.559 INFO 9 --- [ocp-schedules-25,b715486e5c4e3f1e,21433d2d00b88a37] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:37.580 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:37.581 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:47:37.593 INFO 9 --- [ocp-schedules-25,b715486e5c4e3f1e,21433d2d00b88a37] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:47:37.636 INFO 9 --- [prometheus-minute-schedule-1,565359734747679b,67e1830df94b3de2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:37.639 INFO 9 --- [prometheus-minute-schedule-1,565359734747679b,67e1830df94b3de2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:38.767 INFO 9 --- [ocp-async-4,c69ca9dedbbec672,d9f17919baec74aa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:38.767 WARN 9 --- [ocp-async-8,5078cac9b9a2432b,88da73ceaf145e55] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:38.783 INFO 9 --- [ocp-schedules-1,1cfba8868d1a825d,7ae52410b5af4827] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:47:38.785 INFO 9 --- [ocp-schedules-1,1cfba8868d1a825d,7ae52410b5af4827] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:47:39.419 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:39.419 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:39.560 INFO 9 --- [ocp-schedules-24,76b575a3a486f046,56d279e0b7f073df] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:47:39.560 INFO 9 --- [ocp-schedules-24,76b575a3a486f046,56d279e0b7f073df] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:47:39.568 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:47:39.568 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:47:39.568 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:47:39.568 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:47:39.568 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:47:39.568 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:47:39.571 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:47:39.572 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:47:39.572 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:47:39.572 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:39.573 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:47:39.573 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:47:39.573 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:47:39.573 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:39.574 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:47:39.574 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:47:39.575 INFO 9 --- [Collect all tenants major compactions1,76b575a3a486f046,1bfb7f76fa811366] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:47:39.576 INFO 9 --- [Collect all tenants major compactions2,76b575a3a486f046,efe1308628814a50] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:47:39.576 INFO 9 --- [Collect all tenants major compactions3,76b575a3a486f046,36365fd3dc1056e7] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:47:39.588 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:47:39.588 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:47:39.588 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:47:39.589 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:47:39.589 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:47:39.590 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:47:39.593 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:47:39.594 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:47:39.597 INFO 9 --- [Collect all tenants major compactions2,76b575a3a486f046,efe1308628814a50] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:39.598 INFO 9 --- [Collect all tenants major compactions1,76b575a3a486f046,1bfb7f76fa811366] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:39.598 INFO 9 --- [Collect all tenants major compactions2,76b575a3a486f046,efe1308628814a50] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:47:39.598 INFO 9 --- [Collect all tenants major compactions3,76b575a3a486f046,36365fd3dc1056e7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:39.599 INFO 9 --- [Collect all tenants major compactions1,76b575a3a486f046,1bfb7f76fa811366] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:47:39.600 INFO 9 --- [Collect all tenants major compactions3,76b575a3a486f046,36365fd3dc1056e7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:47:39.604 INFO 9 --- [Collect all tenants major compactions1,76b575a3a486f046,1bfb7f76fa811366] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:47:39.604 INFO 9 --- [Collect all tenants major compactions3,76b575a3a486f046,36365fd3dc1056e7] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:47:39.606 INFO 9 --- [Collect all tenants major compactions2,76b575a3a486f046,efe1308628814a50] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:47:39.606 INFO 9 --- [ocp-schedules-24,76b575a3a486f046,56d279e0b7f073df] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:47:39.607 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:47:39.609 INFO 9 --- [ocp-schedules-5,709d222dd86b032a,caea261f93a96416] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:47:39.868 INFO 9 --- [ocp-schedules-13,22b71f5e391ad989,3af5388cdefbb083] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:47:39.872 WARN 9 --- [scanner-1364258-1,22b71f5e391ad989,7daf4b820e891ee4] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:47:39.882 INFO 9 --- [alarm-detect-8,22b71f5e391ad989,af792f2d7f1120a5] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:47:39.885 INFO 9 --- [alarm-detect-16,22b71f5e391ad989,7d266e6b5c1687c3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:47:39.885 INFO 9 --- [alarm-detect-11,22b71f5e391ad989,908ba6266af02629] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:47:39.897 INFO 9 --- [alarm-detect-11,22b71f5e391ad989,6981c6e98ad0927f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:47:40.001 INFO 9 --- [ocp-schedules-11,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:47:40.002 INFO 9 --- [ocp-schedules-7,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:47:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:47:40.003707+08:00, lastProcessTime=2025-09-16T13:47:30.005718+08:00 2025-09-16 13:47:40.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:47:40.003707+08:00 2025-09-16 13:47:40.178 INFO 9 --- [ocp-async-9,e0a53b7e57f47123,d15082f5d8d7ca31] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:47:40.571 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:43:40.397, end=2025-09-16T13:45:40.568} 2025-09-16 13:47:40.575 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbit 2025-09-16 13:47:40.576 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:47:40.582 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 83 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:40.397, end=2025-09-16T13:45:40.568},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:47:40.636 INFO 9 --- [prometheus-minute-schedule-1,e9349d4f9502c849,b7ec54be1f9fd74a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:40.641 INFO 9 --- [prometheus-minute-schedule-1,e9349d4f9502c849,b7ec54be1f9fd74a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:40.684 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:47:40.684 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:47:40.693 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:47:40.695 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:40.397, end=2025-09-16T13:45:40.568},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:47:40.695 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:47:40.695 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:47:40.700 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:47:40.701 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:40.397, end=2025-09-16T13:45:40.568},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:47:40.701 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:47:40.701 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:47:40.705 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:47:40.767 WARN 9 --- [ocp-async-2,56436015b891223d,2e6e78e2b0b8fbdc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:40.767 INFO 9 --- [ocp-async-1,46b02c5013c73c09,5a6373b360b80419] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:41.954 INFO 9 --- [ocp-schedules-6,bcfeae9ddc743675,3f85477f06e74cfd] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:47:41.954 INFO 9 --- [ocp-schedules-6,bcfeae9ddc743675,3f85477f06e74cfd] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:47:41.993 INFO 9 --- [ocp-schedules-6,bcfeae9ddc743675,3f85477f06e74cfd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:41.994 INFO 9 --- [ocp-schedules-6,bcfeae9ddc743675,3f85477f06e74cfd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:47:42.204 INFO 9 --- [ocp-schedules-2,e0e081a0ea7edded,0ac5f4324f53cdb3] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:47:42.205 INFO 9 --- [ocp-schedules-2,e0e081a0ea7edded,0ac5f4324f53cdb3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:42.253 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:47:42.253 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.256 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:47:42.282 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.283 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:47:42.306 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.307 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:47:42.330 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.330 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:47:42.335 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.335 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:47:42.359 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.360 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:47:42.381 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.381 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:47:42.386 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.387 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:47:42.411 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.411 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:47:42.420 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:42.420 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:42.435 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.436 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:47:42.457 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.458 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:47:42.459 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.459 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:47:42.460 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.461 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:47:42.462 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.462 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:47:42.463 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.464 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:47:42.464 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.465 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:47:42.480 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.481 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:47:42.482 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.482 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:47:42.483 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.484 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:47:42.501 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:47:42.506 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:47:42.535 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:47:42.536 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:42.537 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:47:42.564 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:47:42.564 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:47:42.564 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:47:42.564 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:47:42.564 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:47:42.564 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:47:42.566 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:47:42.566 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:47:42.566 INFO 9 --- [ocp-schedules-2,e0e081a0ea7edded,0ac5f4324f53cdb3] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:47:42.767 WARN 9 --- [ocp-async-9,9f2798142488d4d2,6ba43797e786eb09] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:42.767 INFO 9 --- [ocp-async-10,04c301ab06927df4,ae317255b3bf47ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:43.636 INFO 9 --- [prometheus-minute-schedule-1,39e334c962ecf74a,90914f116f8be114] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:43.639 INFO 9 --- [prometheus-minute-schedule-1,39e334c962ecf74a,90914f116f8be114] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 13:47:43,902 |-INFO in ReconfigureOnChangeTask(born:1758001603902) - Empty watch file list. Disabling 2025-09-16 13:47:44.632 INFO 9 --- [ocp-schedules-20,ff5b29d94575b21f,f30252bfe3c11611] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:47:44.767 WARN 9 --- [ocp-async-5,b646906e77415831,084585d99a83038e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:44.768 INFO 9 --- [ocp-async-4,c5ed6eb13ee55520,3bab45a6ae3091bd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:45.420 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:45.421 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:46.636 INFO 9 --- [prometheus-minute-schedule-1,e82e58f29edceee9,bca4a82792ebafde] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:46.639 INFO 9 --- [prometheus-minute-schedule-1,e82e58f29edceee9,bca4a82792ebafde] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:46.768 WARN 9 --- [ocp-async-4,b0e2859e348387d9,d3a38e46a92b3205] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:46.768 INFO 9 --- [ocp-async-6,4cdf4882bb4b7ada,7550d83320ae77f7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:48.421 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:48.421 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:48.768 WARN 9 --- [ocp-async-6,09061c045205df4b,73d790e296602931] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:48.768 INFO 9 --- [ocp-async-1,878f0344bfd4981c,342635807c3932f9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:48.790 INFO 9 --- [ocp-schedules-9,05611d1f9103500c,3943ba6f0bdaf780] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:47:48.792 INFO 9 --- [ocp-schedules-9,05611d1f9103500c,3943ba6f0bdaf780] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:47:49.636 INFO 9 --- [prometheus-minute-schedule-1,5eecd2f7b682ac4b,3cbbbe139cefd23e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:49.639 INFO 9 --- [prometheus-minute-schedule-1,5eecd2f7b682ac4b,3cbbbe139cefd23e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:49.899 INFO 9 --- [ocp-schedules-6,d583a5379c11228a,ed9df73a7b747e7e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:47:49.904 WARN 9 --- [scanner-1364420-1,d583a5379c11228a,c7752b87755366fa] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:47:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:47:50.002894+08:00, lastProcessTime=2025-09-16T13:47:40.003707+08:00 2025-09-16 13:47:50.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:47:50.002894+08:00 2025-09-16 13:47:50.179 INFO 9 --- [ocp-async-3,8768df91b8dee0a1,b57fd46e28aa1ede] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:47:50.768 WARN 9 --- [ocp-async-10,0d04e14540a9089c,ac11b1599c3fe250] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:50.768 INFO 9 --- [ocp-async-5,d7bf849ae10e0911,1253163c3e282521] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:51.421 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:51.422 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:52.636 INFO 9 --- [prometheus-minute-schedule-1,482f29233b3a7963,1887725ed041e162] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:52.639 INFO 9 --- [prometheus-minute-schedule-1,482f29233b3a7963,1887725ed041e162] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:52.768 WARN 9 --- [ocp-async-5,f9bd6a530ba76f03,fa11354d718fc25a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:52.768 INFO 9 --- [ocp-async-3,06a22ffe9ff9846b,a788556c9c5e6537] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:54.422 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:54.423 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:54.511 INFO 9 --- [ocp-schedules-22,db9939cd7897b470,4a7e1377e2561a6c] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:47:54.516 INFO 9 --- [ocp-schedules-22,db9939cd7897b470,4a7e1377e2561a6c] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:47:54.516 INFO 9 --- [ocp-schedules-22,db9939cd7897b470,4a7e1377e2561a6c] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:47:54.636 INFO 9 --- [ocp-schedules-18,d5d9d849507fffee,e8aadafe686514fd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:47:54.768 WARN 9 --- [ocp-async-3,6a67921089d87f37,3018efd99e3b0562] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:54.768 INFO 9 --- [ocp-async-9,aa9b8325d7331850,a37c7e25960a06fe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:55.636 INFO 9 --- [prometheus-minute-schedule-1,d209e52dbe5d3fa7,c729c5316051fa35] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:55.639 INFO 9 --- [prometheus-minute-schedule-1,d209e52dbe5d3fa7,c729c5316051fa35] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:56.768 WARN 9 --- [ocp-async-9,42026ba63ac798ac,972c0aa1a36a9f9e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:56.768 INFO 9 --- [ocp-async-10,d251598f0b863dab,555cd6bf72ab87c7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:57.423 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:47:57.423 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:47:58.636 INFO 9 --- [prometheus-minute-schedule-1,2c14939d06b477f8,a04d2276f12b1a46] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001680, interval=60 2025-09-16 13:47:58.639 INFO 9 --- [prometheus-minute-schedule-1,2c14939d06b477f8,a04d2276f12b1a46] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:47:58.768 WARN 9 --- [ocp-async-10,77dd4b7df675e497,26b04564648ccb49] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:47:58.768 INFO 9 --- [ocp-async-5,594b3a850ceff206,b1e582ea89fb7da3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:47:58.796 INFO 9 --- [ocp-schedules-3,43a7c0a754e0b02a,57e185c9d3922142] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:47:58.798 INFO 9 --- [ocp-schedules-3,43a7c0a754e0b02a,57e185c9d3922142] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:47:59.927 INFO 9 --- [ocp-schedules-26,116dcd5605bca6ae,aaf43e7e8e1137cd] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:47:59.933 WARN 9 --- [scanner-1364552-1,116dcd5605bca6ae,a7692db3424c2003] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:47:59.938 INFO 9 --- [ocp-schedules-23,c2bf5fb66e203db3,426926a8739867bb] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:47:59.941 INFO 9 --- [ocp-schedules-22,41758310667d5eca,d9f52884c26d94f9] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:47:59.941 INFO 9 --- [ocp-schedules-1,558384adadd38fd6,77d695c7a5e54187] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:47:59.944 INFO 9 --- [alarm-detect-17,116dcd5605bca6ae,e0ead4da406d4c70] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:47:59.944 INFO 9 --- [ocp-schedules-9,1f04837cc0e2f27d,0155baf1cf66c618] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:47:59.945 INFO 9 --- [ocp-schedules-1,558384adadd38fd6,77d695c7a5e54187] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:59.946 INFO 9 --- [ocp-schedules-22,41758310667d5eca,d9f52884c26d94f9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:59.946 INFO 9 --- [ocp-schedules-9,1f04837cc0e2f27d,0155baf1cf66c618] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:47:59.947 INFO 9 --- [ocp-schedules-9,1f04837cc0e2f27d,0155baf1cf66c618] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:47:59.947 INFO 9 --- [ocp-schedules-30,cfd97f7a7baa56dd,d676b53a760db284] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:47:59.947 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:47:59.947 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:47:59.947 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:47:59.947 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:47:59.947 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:47:59.947 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:47:59.948 INFO 9 --- [alarm-detect-7,116dcd5605bca6ae,1ba0e94f73c81cfb] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:47:59.948 INFO 9 --- [ocp-schedules-23,40b6fe25fd1edd83,de1119ba15d83092] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:47:59.948 INFO 9 --- [alarm-detect-10,116dcd5605bca6ae,ed353e88a271e4de] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:47:59.948 INFO 9 --- [host-check-agent-status1,40b6fe25fd1edd83,1a72a0054a34c778] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:47:59.948 INFO 9 --- [host-check-agent-status2,40b6fe25fd1edd83,8e2fd04bfb7c387c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:47:59.949 INFO 9 --- [host-check-agent-status4,40b6fe25fd1edd83,1ef64194a962ec56] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:47:59.949 INFO 9 --- [host-check-agent-status5,40b6fe25fd1edd83,4f9c7cc34e68b341] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:47:59.950 INFO 9 --- [host-check-agent-status6,40b6fe25fd1edd83,d3ed65f3571876af] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:47:59.950 INFO 9 --- [ocp-schedules-11,59a23a607e299c34,102897039baeb55c] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:47:59.950 INFO 9 --- [host-check-agent-status3,40b6fe25fd1edd83,cf85e1e33c9e32a5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:47:59.950 INFO 9 --- [ocp-schedules-3,8dcda2c52ff7b633,efd0216d1e173e3a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:47:59.950 INFO 9 --- [host-check-clockdiff1,59a23a607e299c34,64f25686a0d33d15] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:47:59.951 INFO 9 --- [host-check-clockdiff2,59a23a607e299c34,e811c8936b94dff1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:47:59.951 INFO 9 --- [host-check-clockdiff3,59a23a607e299c34,50ee74acfd5db48b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:47:59.951 INFO 9 --- [host-check-clockdiff4,59a23a607e299c34,0502c758d9118f54] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:47:59.954 INFO 9 --- [host-check-clockdiff6,59a23a607e299c34,268c5f51a4ef2e52] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:47:59.954 INFO 9 --- [host-check-clockdiff5,59a23a607e299c34,3d8326402760826d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:47:59.965 INFO 9 --- [host-check-clockdiff4,59a23a607e299c34,0502c758d9118f54] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001679 -1 -1 , error= 2025-09-16 13:47:59.967 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:47:59.968 INFO 9 --- [host-check-clockdiff1,59a23a607e299c34,64f25686a0d33d15] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001679 -1 -1 , error= 2025-09-16 13:47:59.968 INFO 9 --- [host-check-clockdiff2,59a23a607e299c34,e811c8936b94dff1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001679 -1 -1 , error= 2025-09-16 13:47:59.969 INFO 9 --- [host-check-agent-status1,40b6fe25fd1edd83,1a72a0054a34c778] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:47:59.973 INFO 9 --- [host-check-agent-status1,40b6fe25fd1edd83,1a72a0054a34c778] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:47:59.973 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:47:59.973 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:47:59.975 INFO 9 --- [host-check-clockdiff3,59a23a607e299c34,50ee74acfd5db48b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001679 -1 -1 , error= 2025-09-16 13:47:59.976 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:47:59.976 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:47:59.976 INFO 9 --- [host-check-agent-status5,40b6fe25fd1edd83,4f9c7cc34e68b341] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:47:59.977 INFO 9 --- [host-check-agent-status2,40b6fe25fd1edd83,8e2fd04bfb7c387c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:47:59.977 INFO 9 --- [host-check-agent-status3,40b6fe25fd1edd83,cf85e1e33c9e32a5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:47:59.977 INFO 9 --- [host-check-agent-status4,40b6fe25fd1edd83,1ef64194a962ec56] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:47:59.977 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:47:59.977 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:59.978 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:47:59.978 INFO 9 --- [host-check-agent-status5,40b6fe25fd1edd83,4f9c7cc34e68b341] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:47:59.978 INFO 9 --- [host-check-agent-status6,40b6fe25fd1edd83,d3ed65f3571876af] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:47:59.978 INFO 9 --- [host-check-agent-status2,40b6fe25fd1edd83,8e2fd04bfb7c387c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:47:59.978 INFO 9 --- [host-check-agent-status4,40b6fe25fd1edd83,1ef64194a962ec56] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:47:59.978 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:47:59.979 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:47:59.979 INFO 9 --- [host-check-agent-status3,40b6fe25fd1edd83,cf85e1e33c9e32a5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:47:59.979 INFO 9 --- [host-check-agent-status6,40b6fe25fd1edd83,d3ed65f3571876af] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:59.980 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:47:59.980 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:47:59.995 INFO 9 --- [alarm-detect-5,116dcd5605bca6ae,d2a5be2ff3ced8f4] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:47:59.998 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-agent-status1,40b6fe25fd1edd83,1a72a0054a34c778] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-agent-status5,40b6fe25fd1edd83,4f9c7cc34e68b341] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-agent-status2,40b6fe25fd1edd83,8e2fd04bfb7c387c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-agent-status4,40b6fe25fd1edd83,1ef64194a962ec56] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:47:59.998 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:47:59.998 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:47:59.999 INFO 9 --- [host-check-agent-status6,40b6fe25fd1edd83,d3ed65f3571876af] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:47:59.999 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:47:59.999 INFO 9 --- [host-check-agent-status3,40b6fe25fd1edd83,cf85e1e33c9e32a5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:47:59.999 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:47:59.998502071+08:00 2025-09-16 13:47:59.999 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:47:59.999 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:47:59.999+08:00 2025-09-16 13:48:00.000 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:47:59.998626137+08:00 2025-09-16 13:48:00.000 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:47:59.998549574+08:00 2025-09-16 13:48:00.000 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:48+08:00 2025-09-16 13:48:00.000 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:48+08:00 2025-09-16 13:48:00.000 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:47:59.999550177+08:00 2025-09-16 13:48:00.000 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:47:59.999300301+08:00 2025-09-16 13:48:00.000 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:48+08:00 2025-09-16 13:48:00.001 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:48+08:00 2025-09-16 13:48:00.001 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:48:00.000034262+08:00 2025-09-16 13:48:00.001 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:48:00.001+08:00 2025-09-16 13:48:00.001 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:47:59.999+08:00 and status AVAILABLE 2025-09-16 13:48:00.002 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:48+08:00 and status AVAILABLE 2025-09-16 13:48:00.002 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:48+08:00 and status AVAILABLE 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status2,40b6fe25fd1edd83,8e2fd04bfb7c387c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status2,40b6fe25fd1edd83,8e2fd04bfb7c387c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status2,40b6fe25fd1edd83,8e2fd04bfb7c387c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status4,40b6fe25fd1edd83,1ef64194a962ec56] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status4,40b6fe25fd1edd83,1ef64194a962ec56] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status4,40b6fe25fd1edd83,1ef64194a962ec56] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status5,40b6fe25fd1edd83,4f9c7cc34e68b341] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:48:00.002 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:48+08:00 and status AVAILABLE 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status5,40b6fe25fd1edd83,4f9c7cc34e68b341] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status5,40b6fe25fd1edd83,4f9c7cc34e68b341] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:48:00.002 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:48+08:00 and status AVAILABLE 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status1,40b6fe25fd1edd83,1a72a0054a34c778] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status1,40b6fe25fd1edd83,1a72a0054a34c778] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:48:00.002 INFO 9 --- [host-check-agent-status1,40b6fe25fd1edd83,1a72a0054a34c778] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:48:00.003 INFO 9 --- [host-check-agent-status3,40b6fe25fd1edd83,cf85e1e33c9e32a5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:48:00.003 INFO 9 --- [host-check-agent-status3,40b6fe25fd1edd83,cf85e1e33c9e32a5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:48:00.003 INFO 9 --- [host-check-agent-status3,40b6fe25fd1edd83,cf85e1e33c9e32a5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:48:00.003 INFO 9 --- [host-check-agent-status6,40b6fe25fd1edd83,d3ed65f3571876af] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:48:00.003 INFO 9 --- [host-check-agent-status6,40b6fe25fd1edd83,d3ed65f3571876af] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:48:00.003 INFO 9 --- [host-check-agent-status6,40b6fe25fd1edd83,d3ed65f3571876af] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:48:00.003 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:48:00.001+08:00 and status AVAILABLE 2025-09-16 13:48:00.004 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:48:00.004 INFO 9 --- [ocp-schedules-1,558384adadd38fd6,77d695c7a5e54187] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:48:00.005 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:48:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:48:00.004374+08:00, lastProcessTime=2025-09-16T13:47:50.002894+08:00 2025-09-16 13:48:00.006 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:48:00.006 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:48:00.006 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:48:00.006 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:48:00.006 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:48:00.011 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:00.011 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:00.012 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:00.012 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:00.012 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:00.012 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:00.013 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:00.013 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:00.013 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:00.013 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:00.013 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:00.014 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:00.015 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:00.015 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:48:00.025 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:00.027 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:00.027 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:00.027 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:00.028 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:00.028 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:00.054 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:48:00.054 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:48:00.057 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:48:00.057 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:00.057 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:48:00.058 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:48:00.058 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:48:00.059 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:00.059 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:48:00.060 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:48:00.061 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:48:00.063 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:48:00.064 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:48:00.064 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:48:00.065 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:48:00.073 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:00.073 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:00.075 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:00.075 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:00.075 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:00.075 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:00.094 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:00.096 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:00.096 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:48:00.100 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:48:00.100 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:00.101 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:48:00.102 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:48:00.103 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:48:00.103 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:48:00.104 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:48:00.104 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:00.106 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:48:00.108 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:48:00.110 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:48:00.110 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:48:00.110 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:48:00.111 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:48:00.117 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:48:00.120 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:00.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:00.120 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:00.121 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:00.122 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:00.123 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:00.129 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:00.147 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:48:00.148 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:48:00.149 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:48:00.004374+08:00 2025-09-16 13:48:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.149 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:48:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:00.153 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:48:00.153 INFO 9 --- [host-check-host-status5,cfd97f7a7baa56dd,1a32b91c648f0761] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:48:00.154 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:48:00.155 INFO 9 --- [host-check-host-status2,cfd97f7a7baa56dd,02c9b1520216d65c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:48:00.156 INFO 9 --- [host-check-host-status3,cfd97f7a7baa56dd,a3aacafd92a6c7c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:48:00.159 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:48:00.159 INFO 9 --- [host-check-host-status4,cfd97f7a7baa56dd,c8412ec0284dfa6f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:48:00.160 INFO 9 --- [host-check-host-status1,cfd97f7a7baa56dd,616d3b217d5d7699] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:48:00.166 INFO 9 --- [host-check-host-status6,cfd97f7a7baa56dd,116364a1a8b7fed4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:48:00.167 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.167 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:00.179 INFO 9 --- [ocp-async-9,0d9e4758b4a7dac9,cacccb1da00f1d9e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:48:00.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:00.196 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.196 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:00.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:00.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:00.238 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.238 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:00.253 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:00.267 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:00.268 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:00.269 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:00.274 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:48:00.277 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:48:00.280 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:00.281 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:00.293 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:48:00.353 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:48:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:00.368 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:00.368 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:48:00.382 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:48:00.382 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:48:00.382 INFO 9 --- [ocp-schedules-22,41758310667d5eca,d9f52884c26d94f9] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:48:00.423 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:00.424 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:00.768 WARN 9 --- [ocp-async-3,64f1db9e77574539,a1124fff61092ba1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:00.768 INFO 9 --- [ocp-async-8,e72bfb78ebcc784d,8023e4777b04a862] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:00.819 INFO 9 --- [ocp-schedules-29,e6234256b36e1160,97a686b48173eb4f] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:48:00.895 INFO 9 --- [host-check-clockdiff5,59a23a607e299c34,3d8326402760826d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001680 -1 -1 , error= 2025-09-16 13:48:00.896 INFO 9 --- [host-check-clockdiff6,59a23a607e299c34,268c5f51a4ef2e52] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001680 -1 -1 , error= 2025-09-16 13:48:01.636 INFO 9 --- [prometheus-minute-schedule-1,37ef388ff4368389,94e850f5ee2d3e4c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:01.639 INFO 9 --- [prometheus-minute-schedule-1,37ef388ff4368389,94e850f5ee2d3e4c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:02.769 WARN 9 --- [ocp-async-7,56da7d0c2a79df26,2e5a6fc2ab4ee769] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:02.769 INFO 9 --- [ocp-async-9,ae3fb1a2e04b64cb,1901b7275b284ee6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:03.424 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:03.425 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:04.636 INFO 9 --- [prometheus-minute-schedule-1,a99181ed2683a7c9,c88a0732262a8d3d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:04.639 INFO 9 --- [ocp-schedules-2,80c436d6896a495b,9297da36a7e47210] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:48:04.639 INFO 9 --- [prometheus-minute-schedule-1,a99181ed2683a7c9,c88a0732262a8d3d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:04.769 WARN 9 --- [ocp-async-10,1f72df65892f33a8,2ea33e95f9f95405] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:04.769 INFO 9 --- [ocp-async-2,9ad6133276b86d14,53cc7a58fefebb5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:06.201 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,5b6a043e0aeaa9e1,7efa75dce877c0f4] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=5b6a043e0aeaa9e1, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:48:06.201 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,5b6a043e0aeaa9e1,7efa75dce877c0f4] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=5b6a043e0aeaa9e1, duration=1 ms] 2025-09-16 13:48:06.203 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,1db385c7afbaddc8,fbeeb944c22b8357] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba, client=10.232.140.0, traceId=1db385c7afbaddc8, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,false,] 2025-09-16 13:48:06.203 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,1db385c7afbaddc8,fbeeb944c22b8357] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=1db385c7afbaddc8, duration=1 ms] 2025-09-16 13:48:06.425 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:06.425 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:06.769 WARN 9 --- [ocp-async-6,09ce843ef4b5278b,c4c97257fa2e2570] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:06.769 INFO 9 --- [ocp-async-3,a89d0b56148241da,7c243c9c248c947e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:07.636 INFO 9 --- [prometheus-minute-schedule-1,0cc47f76d36659d2,c2b1f9ce66269284] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:07.639 INFO 9 --- [prometheus-minute-schedule-1,0cc47f76d36659d2,c2b1f9ce66269284] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:08.769 WARN 9 --- [ocp-async-8,6783ef561e315d35,ad03f03cb361806f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:08.769 INFO 9 --- [ocp-async-7,1c2fc0d59df43b64,f4e14412a7c528fa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:08.802 INFO 9 --- [ocp-schedules-12,ea90ff322078525f,89729e038c2feddf] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:48:08.804 INFO 9 --- [ocp-schedules-12,ea90ff322078525f,89729e038c2feddf] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:48:09.425 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:09.426 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:09.998 INFO 9 --- [ocp-schedules-15,59e38b2090de2cef,1e7a45208fa3be4d] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:48:10.005 INFO 9 --- [ocp-schedules-29,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:48:10.006 INFO 9 --- [ocp-schedules-8,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:48:10.008 WARN 9 --- [scanner-1364723-1,59e38b2090de2cef,44839695f4861f82] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:48:10.009 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:48:10.007202+08:00, lastProcessTime=2025-09-16T13:48:00.004374+08:00 2025-09-16 13:48:10.116 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:48:10.007202+08:00 2025-09-16 13:48:10.179 INFO 9 --- [ocp-async-6,077b3b6910fa3e5f,5a1249d0eac1cf1c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:48:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:48:10.636 INFO 9 --- [prometheus-minute-schedule-1,9dcbbbc7e189cfb6,8c648991924813ec] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:10.639 INFO 9 --- [prometheus-minute-schedule-1,9dcbbbc7e189cfb6,8c648991924813ec] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:10.769 WARN 9 --- [ocp-async-10,6703d8264fd04a74,91f96d4ae16a1425] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:10.769 INFO 9 --- [ocp-async-5,b11c9b11dd6742e7,70bfbf30dd0a9288] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:11.702 INFO 9 --- [metric-archive-async-1,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001620, nodeCount=460, affectRows=460 2025-09-16 13:48:12.426 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:12.426 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:12.769 WARN 9 --- [ocp-async-6,ea0d83e480eb46ae,3f3d93c7332e5602] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:12.769 INFO 9 --- [ocp-async-1,807eec42aca1f564,1ef4792c62aef078] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:13.333 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001620, nodeCount=1000, affectRows=1000 2025-09-16 13:48:13.336 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001620, nodeCount=1000, validCount=996 2025-09-16 13:48:13.361 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001620, nodeCount=1000, affectRows=1000 2025-09-16 13:48:13.364 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001620, nodeCount=1000, validCount=998 2025-09-16 13:48:13.375 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952612204544-1758001560' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952612204544-1758001560' for key 'PRIMARY' 2025-09-16 13:48:13.636 INFO 9 --- [prometheus-minute-schedule-1,720cb9f2cba429d2,9120df63cf75eaea] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:13.640 INFO 9 --- [prometheus-minute-schedule-1,720cb9f2cba429d2,9120df63cf75eaea] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:14.518 INFO 9 --- [ocp-schedules-11,886f99d54113fde8,7dc8ceae5af9b429] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:48:14.522 INFO 9 --- [ocp-schedules-11,886f99d54113fde8,7dc8ceae5af9b429] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:48:14.522 INFO 9 --- [ocp-schedules-11,886f99d54113fde8,7dc8ceae5af9b429] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:48:14.642 INFO 9 --- [ocp-schedules-7,4d3a27c97defed9f,a1f47f1eb8850970] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:48:14.689 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001620, nodeCount=1000, affectRows=1000 2025-09-16 13:48:14.691 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001620, nodeCount=991, validCount=945 2025-09-16 13:48:14.714 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001620, nodeCount=853, affectRows=853 2025-09-16 13:48:14.716 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001620, nodeCount=853, validCount=851 2025-09-16 13:48:14.769 WARN 9 --- [ocp-async-8,7690238d1808866d,d89e33021efaffd1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:14.769 INFO 9 --- [ocp-async-4,5464b960e44fff8a,c8aadc6cb5228f46] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:15.426 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:15.427 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:16.636 INFO 9 --- [prometheus-minute-schedule-1,35ef41492b4fe7c3,1dde0ce1bc6fac98] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:16.639 INFO 9 --- [prometheus-minute-schedule-1,35ef41492b4fe7c3,1dde0ce1bc6fac98] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:16.769 WARN 9 --- [ocp-async-9,82757728884557e9,46ba27e00ea38131] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:16.769 INFO 9 --- [ocp-async-10,b91efe18bda9a0e7,fb7ad7757629a601] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:18.427 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:18.428 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:18.770 WARN 9 --- [ocp-async-5,3d5728b3ee23bef1,58ab1a20d0757ac8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:18.770 INFO 9 --- [ocp-async-6,a752ce2913068e1d,e0db3e7a0813bcc5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:18.808 INFO 9 --- [ocp-schedules-5,7ee250b8af683f10,92cb635020fc4a19] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:48:18.810 INFO 9 --- [ocp-schedules-5,7ee250b8af683f10,92cb635020fc4a19] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:48:19.636 INFO 9 --- [prometheus-minute-schedule-1,b6ed3cde4624274c,8854fe0a1853a688] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:19.639 INFO 9 --- [prometheus-minute-schedule-1,b6ed3cde4624274c,8854fe0a1853a688] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:48:20.003571+08:00, lastProcessTime=2025-09-16T13:48:10.007202+08:00 2025-09-16 13:48:20.029 INFO 9 --- [ocp-schedules-14,9083c195de721228,448c276ca4ed381f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:48:20.035 WARN 9 --- [scanner-1365721-1,9083c195de721228,17596a9c5fe8c6ea] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:48:20.044 INFO 9 --- [alarm-detect-9,9083c195de721228,10d119cfc9d7615e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:48:20.046 INFO 9 --- [alarm-detect-20,9083c195de721228,006bdeb5bfcdac13] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:48:20.047 INFO 9 --- [alarm-detect-13,9083c195de721228,8cad27afd8a04dca] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:48:20.058 INFO 9 --- [alarm-detect-5,9083c195de721228,f1adcde4c185dcb9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:48:20.131 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:48:20.003571+08:00 2025-09-16 13:48:20.179 INFO 9 --- [ocp-async-9,8ee3f82a29715bba,5a1b91cbb7e6bf8c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:48:20.636 INFO 9 --- [prometheus-cache-monitor1,b7b958ae48cf39f3,f8a1b29377105278] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:48:20.636 INFO 9 --- [prometheus-cache-monitor1,b7b958ae48cf39f3,f8a1b29377105278] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:48:20.770 WARN 9 --- [ocp-async-8,18700b4459fdafeb,80b77cc280016e2e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:20.770 INFO 9 --- [ocp-async-7,3201f1b27d2dcdde,69a27d7a0bc48e23] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:21.428 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:21.428 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:22.636 INFO 9 --- [prometheus-minute-schedule-1,1e1d68e3e1686e07,d330ae30e6ca5e59] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:22.639 INFO 9 --- [prometheus-minute-schedule-1,1e1d68e3e1686e07,d330ae30e6ca5e59] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:22.770 WARN 9 --- [ocp-async-9,d073822c83c92743,252ddca1b0bb48cc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:22.770 INFO 9 --- [ocp-async-2,a57dfed1d2e1b8c3,3baf41296f34788a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:24.428 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:24.429 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:24.645 INFO 9 --- [ocp-schedules-30,988b9d7da6cfcc7b,86a58ded456e14a3] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:48:24.770 WARN 9 --- [ocp-async-5,716e9df7a6ddaee3,37ff58e8bad4b6c7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:24.770 INFO 9 --- [ocp-async-3,91895879f8f7d8a1,0197a1a2c4ed4b08] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:25.636 INFO 9 --- [prometheus-minute-schedule-1,9b0292cd462c45d7,5cf30971a4336ce7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:25.639 INFO 9 --- [prometheus-minute-schedule-1,9b0292cd462c45d7,5cf30971a4336ce7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:26.770 WARN 9 --- [ocp-async-1,f1172e140949a0ec,47291866cb81a2fa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:26.770 INFO 9 --- [ocp-async-8,8dee8cc871427fc9,9d43d42da7bac6f9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:27.429 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:27.429 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:28.636 INFO 9 --- [prometheus-minute-schedule-1,21b5c93f6368956d,23f963bb903b2865] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:28.639 INFO 9 --- [prometheus-minute-schedule-1,21b5c93f6368956d,23f963bb903b2865] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:28.770 WARN 9 --- [ocp-async-7,b3a1b241c90edb31,fd8a711a17392cbb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:28.770 INFO 9 --- [ocp-async-9,149aaa2e19c58405,46807f46f9577cbd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:28.816 INFO 9 --- [ocp-schedules-18,871d3542d32f393c,3aab35329f301060] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:48:28.818 INFO 9 --- [ocp-schedules-18,871d3542d32f393c,3aab35329f301060] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:48:29.938 INFO 9 --- [ocp-schedules-16,48c27a78b74b5027,c8559e48c6237d0e] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:48:29.941 INFO 9 --- [ocp-schedules-28,bc793b8b935f2a12,c2de04c4a075a0b8] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:48:29.941 INFO 9 --- [ocp-schedules-15,37d7768c3f4ec8f6,29245cc04bce7837] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:48:29.942 INFO 9 --- [ocp-schedules-18,49ddd19ccfe0dd2a,7068da6458454b5f] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:48:29.943 INFO 9 --- [ocp-schedules-15,37d7768c3f4ec8f6,29245cc04bce7837] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:29.943 INFO 9 --- [ocp-schedules-28,bc793b8b935f2a12,c2de04c4a075a0b8] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:29.944 INFO 9 --- [ocp-schedules-18,49ddd19ccfe0dd2a,7068da6458454b5f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:29.944 INFO 9 --- [ocp-schedules-18,49ddd19ccfe0dd2a,7068da6458454b5f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:48:29.944 INFO 9 --- [ocp-schedules-11,883a307d970f16b5,79743ae44b85257d] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:29.944 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:48:29.944 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:48:29.944 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:48:29.944 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:48:29.944 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:48:29.945 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:48:29.945 INFO 9 --- [ocp-schedules-1,eec7ae9e390b8fee,aed8791c7a450e14] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:29.946 INFO 9 --- [host-check-agent-status1,eec7ae9e390b8fee,177d4a741471a8d8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:48:29.946 INFO 9 --- [host-check-agent-status2,eec7ae9e390b8fee,5bc009ae6cfd902f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:48:29.946 INFO 9 --- [host-check-agent-status3,eec7ae9e390b8fee,1cbf0d910eab1e34] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:48:29.946 INFO 9 --- [host-check-agent-status4,eec7ae9e390b8fee,2d6dfd35d9889ee6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:48:29.946 INFO 9 --- [host-check-agent-status5,eec7ae9e390b8fee,3928bbcf4c2ee00a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:48:29.946 INFO 9 --- [ocp-schedules-16,9ddcd06c2fae6a1f,6ec2fe3d5a11f3d8] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:29.946 INFO 9 --- [host-check-agent-status6,eec7ae9e390b8fee,462d8fc1633b6af9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:48:29.946 INFO 9 --- [host-check-clockdiff1,9ddcd06c2fae6a1f,26d4cfb541cdcd40] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:48:29.946 INFO 9 --- [host-check-clockdiff2,9ddcd06c2fae6a1f,c47bef337a57307b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:48:29.946 INFO 9 --- [host-check-clockdiff3,9ddcd06c2fae6a1f,44c0c0976763542a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:48:29.946 INFO 9 --- [host-check-clockdiff4,9ddcd06c2fae6a1f,1c6de659ef30b3c4] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:48:29.946 INFO 9 --- [host-check-clockdiff5,9ddcd06c2fae6a1f,779d629a7da158e2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:48:29.946 INFO 9 --- [host-check-clockdiff6,9ddcd06c2fae6a1f,591b73f4891f3c92] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:48:29.947 INFO 9 --- [ocp-schedules-5,4e574ecd1ea99dad,b569d40eaf64b9e8] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:48:29.948 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:29.948 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:29.952 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:29.952 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:29.953 INFO 9 --- [ocp-schedules-26,e67dffb7055755d3,4172a7dd69da21c5] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2025-09-16 13:48:29.953 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:29.953 INFO 9 --- [host-check-clockdiff2,9ddcd06c2fae6a1f,c47bef337a57307b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001709 -2 -2 , error= 2025-09-16 13:48:29.953 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:29.953 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:29.953 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:29.953 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:29.954 INFO 9 --- [host-check-clockdiff5,9ddcd06c2fae6a1f,779d629a7da158e2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001709 -1 -1 , error= 2025-09-16 13:48:29.954 INFO 9 --- [host-check-agent-status5,eec7ae9e390b8fee,3928bbcf4c2ee00a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:29.954 INFO 9 --- [host-check-agent-status6,eec7ae9e390b8fee,462d8fc1633b6af9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:29.954 INFO 9 --- [host-check-agent-status4,eec7ae9e390b8fee,2d6dfd35d9889ee6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:29.954 INFO 9 --- [ocp-schedules-26,e67dffb7055755d3,4172a7dd69da21c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:29.954 INFO 9 --- [host-check-agent-status1,eec7ae9e390b8fee,177d4a741471a8d8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:29.954 INFO 9 --- [host-check-agent-status2,eec7ae9e390b8fee,5bc009ae6cfd902f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:29.954 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:29.954 INFO 9 --- [host-check-clockdiff4,9ddcd06c2fae6a1f,1c6de659ef30b3c4] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001709 -1 -1 , error= 2025-09-16 13:48:29.955 INFO 9 --- [host-check-agent-status3,eec7ae9e390b8fee,1cbf0d910eab1e34] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:29.955 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:29.955 INFO 9 --- [host-check-clockdiff3,9ddcd06c2fae6a1f,44c0c0976763542a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001709 -1 -1 , error= 2025-09-16 13:48:29.955 INFO 9 --- [host-check-clockdiff6,9ddcd06c2fae6a1f,591b73f4891f3c92] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001709 -1 -1 , error= 2025-09-16 13:48:29.955 INFO 9 --- [host-check-clockdiff1,9ddcd06c2fae6a1f,26d4cfb541cdcd40] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001709 -1 -1 , error= 2025-09-16 13:48:29.955 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:29.956 INFO 9 --- [host-check-agent-status3,eec7ae9e390b8fee,1cbf0d910eab1e34] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:29.956 INFO 9 --- [host-check-agent-status4,eec7ae9e390b8fee,2d6dfd35d9889ee6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:29.956 INFO 9 --- [host-check-agent-status5,eec7ae9e390b8fee,3928bbcf4c2ee00a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:29.956 INFO 9 --- [host-check-agent-status1,eec7ae9e390b8fee,177d4a741471a8d8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:29.956 INFO 9 --- [host-check-agent-status2,eec7ae9e390b8fee,5bc009ae6cfd902f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:29.956 INFO 9 --- [host-check-agent-status6,eec7ae9e390b8fee,462d8fc1633b6af9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:29.962 INFO 9 --- [ocp-schedules-3,41762f86c6a91bf4,d7f5929c208ee280] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:48:29.963 INFO 9 --- [ocp-schedules-13,9284e3c85a38f71a,9c4e0a330dece459] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:48:29.967 INFO 9 --- [ocp-schedules-3,41762f86c6a91bf4,d7f5929c208ee280] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:48:29.970 INFO 9 --- [ocp-schedules-13,9284e3c85a38f71a,9c4e0a330dece459] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:48:29.970 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:48:29.970 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:48:29.971 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:48:29.971 INFO 9 --- [ocp-schedules-29,7e69eb020f59a80d,85a7e68ac0c47154] c.o.o.s.common.scheduled.OcpSchedules : Cleanup ocp connection pools. 2025-09-16 13:48:29.971 INFO 9 --- [ocp-schedules-29,7e69eb020f59a80d,85a7e68ac0c47154] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2025-09-16 13:48:29.971 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:48:29.971 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:48:29.972 INFO 9 --- [host-check-agent-status6,eec7ae9e390b8fee,462d8fc1633b6af9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:48:29.972 INFO 9 --- [host-check-agent-status4,eec7ae9e390b8fee,2d6dfd35d9889ee6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:48:29.972 INFO 9 --- [host-check-agent-status5,eec7ae9e390b8fee,3928bbcf4c2ee00a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:48:29.972 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:48:29.972 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:48:29.970973894+08:00 2025-09-16 13:48:29.972 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:48:29.971674401+08:00 2025-09-16 13:48:29.972 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:48:29.972+08:00 2025-09-16 13:48:29.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:29.972 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:48:29.971494751+08:00 2025-09-16 13:48:29.973 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:48:29.972+08:00 2025-09-16 13:48:29.973 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:48:29.971601403+08:00 2025-09-16 13:48:29.973 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:48:29.972+08:00 2025-09-16 13:48:29.973 INFO 9 --- [host-check-agent-status3,eec7ae9e390b8fee,1cbf0d910eab1e34] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:48:29.973 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:48:29.973+08:00 2025-09-16 13:48:29.973 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:48:29.972231186+08:00 2025-09-16 13:48:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:29.974 INFO 9 --- [host-check-agent-status1,eec7ae9e390b8fee,177d4a741471a8d8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:48:29.974 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:48:29.973+08:00 2025-09-16 13:48:29.974 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:48:29.973439901+08:00 2025-09-16 13:48:29.974 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:48:29.972+08:00 and status AVAILABLE 2025-09-16 13:48:29.974 INFO 9 --- [host-check-agent-status2,eec7ae9e390b8fee,5bc009ae6cfd902f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:48:29.974 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:48:29.972+08:00 and status AVAILABLE 2025-09-16 13:48:29.974 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:48:29.974+08:00 2025-09-16 13:48:29.974 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:48:29.972+08:00 and status AVAILABLE 2025-09-16 13:48:29.975 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:48:29.973+08:00 and status AVAILABLE 2025-09-16 13:48:29.975 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:48:29.973+08:00 and status AVAILABLE 2025-09-16 13:48:29.975 INFO 9 --- [host-check-agent-status6,eec7ae9e390b8fee,462d8fc1633b6af9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:48:29.975 INFO 9 --- [host-check-agent-status6,eec7ae9e390b8fee,462d8fc1633b6af9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:48:29.975 INFO 9 --- [host-check-agent-status6,eec7ae9e390b8fee,462d8fc1633b6af9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:48:29.976 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status4,eec7ae9e390b8fee,2d6dfd35d9889ee6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status3,eec7ae9e390b8fee,1cbf0d910eab1e34] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status4,eec7ae9e390b8fee,2d6dfd35d9889ee6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status3,eec7ae9e390b8fee,1cbf0d910eab1e34] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status4,eec7ae9e390b8fee,2d6dfd35d9889ee6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status3,eec7ae9e390b8fee,1cbf0d910eab1e34] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status5,eec7ae9e390b8fee,3928bbcf4c2ee00a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status5,eec7ae9e390b8fee,3928bbcf4c2ee00a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:48:29.976 INFO 9 --- [host-check-agent-status5,eec7ae9e390b8fee,3928bbcf4c2ee00a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:48:29.976 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:48:29.974+08:00 and status AVAILABLE 2025-09-16 13:48:29.977 INFO 9 --- [host-check-agent-status1,eec7ae9e390b8fee,177d4a741471a8d8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:48:29.977 INFO 9 --- [host-check-agent-status1,eec7ae9e390b8fee,177d4a741471a8d8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:48:29.977 INFO 9 --- [host-check-agent-status1,eec7ae9e390b8fee,177d4a741471a8d8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:48:29.977 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:48:29.977 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:48:29.977 INFO 9 --- [pool-overview-container-4,461f5c5fb5f798a6,5923a7a03a4ff7fa] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:48:29.978 INFO 9 --- [host-check-agent-status2,eec7ae9e390b8fee,5bc009ae6cfd902f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:48:29.978 INFO 9 --- [host-check-agent-status2,eec7ae9e390b8fee,5bc009ae6cfd902f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:48:29.978 INFO 9 --- [host-check-agent-status2,eec7ae9e390b8fee,5bc009ae6cfd902f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:48:29.978 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:48:29.978 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:29.978 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:48:29.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:48:29.979 INFO 9 --- [ocp-schedules-15,37d7768c3f4ec8f6,29245cc04bce7837] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:48:29.979 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:48:29.979 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2025-09-16 13:48:29.980 INFO 9 --- [pool-overview-container-2,2a0b88b28d067f02,eda069e16f2a93ba] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:48:29.982 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:29.983 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:29.983 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:29.983 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:29.984 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:29.984 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:29.984 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:29.984 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:29.985 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:29.985 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:29.985 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:29.986 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:29.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:48:29.993 INFO 9 --- [pool-12-thread-11,461f5c5fb5f798a6,95244e51f90df7e6] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get outline history 2025-09-16 13:48:29.994 INFO 9 --- [pool-12-thread-9,461f5c5fb5f798a6,1ca1037ffaa146f5] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get Cluster Sql Stat 2025-09-16 13:48:29.994 INFO 9 --- [pool-12-thread-9,461f5c5fb5f798a6,1ca1037ffaa146f5] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster slow Sql Stat 2025-09-16 13:48:29.994 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,9d84d870d58e8cb9,b017cf8bd1e230dc] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=zhengqi&ObClusterId=1&version=2, client=10.232.140.0, traceId=9d84d870d58e8cb9, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getRootServiceInfo(String,Long,String,Long,boolean,Integer), args=zhengqi,1,false,2,] 2025-09-16 13:48:29.994 INFO 9 --- [pool-12-thread-10,461f5c5fb5f798a6,030412be7e21e820] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to get cluster trans stat 2025-09-16 13:48:29.994 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,9d84d870d58e8cb9,b017cf8bd1e230dc] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=9d84d870d58e8cb9, duration=1 ms] 2025-09-16 13:48:29.994 INFO 9 --- [pool-12-thread-12,461f5c5fb5f798a6,bde3c2d9fc40a9a6] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster session stat 2025-09-16 13:48:29.995 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:29.996 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2025-09-16 13:48:29.996 INFO 9 --- [ForkJoinPool-10-worker-13,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:48:29.996 INFO 9 --- [ForkJoinPool-10-worker-6,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:48:29.997 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get tenant session stat of zhengqi 2025-09-16 13:48:29.997 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get session of zhengqi 2025-09-16 13:48:29.997 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:29.998 INFO 9 --- [pool-12-thread-10,461f5c5fb5f798a6,030412be7e21e820] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to attach trans id 2025-09-16 13:48:29.998 INFO 9 --- [pool-12-thread-10,461f5c5fb5f798a6,030412be7e21e820] c.o.o.p.t.i.ObTransactionDiagServiceImpl : finish fetching trans data 2025-09-16 13:48:29.998 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:29.999 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:29.999 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:29.999 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:30.000 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:48:30.003 INFO 9 --- [pool-overview-container-1,b92b2f4bde0f1ea5,112514a1a66bb746] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:48:30.003732+08:00, lastProcessTime=2025-09-16T13:48:20.003571+08:00 2025-09-16 13:48:30.005 INFO 9 --- [pool-overview-container-1,b92b2f4bde0f1ea5,112514a1a66bb746] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ SVR_IP, SVR_PORT, ZONE, CPU_CAPACITY, CPU_CAPACITY_MAX, CPU_ASSIGNED, CPU_ASSIGNED_MAX, MEM_CAPACITY, MEM_CAPACITY AS MEM_CAPACITY_MAX, MEM_ASSIGNED, MEM_ASSIGNED AS MEM_ASSIGNED_MAX, LOG_DISK_CAPACITY, LOG_DISK_ASSIGNED, LOG_DISK_IN_USE, DATA_DISK_CAPACITY, DATA_DISK_IN_USE FROM oceanbase.GV$OB_SERVERS 2025-09-16 13:48:30.008 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.010 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.159, 2882] 2025-09-16 13:48:30.014 INFO 9 --- [pool-12-thread-9,461f5c5fb5f798a6,1ca1037ffaa146f5] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster anomaly sql Stat 2025-09-16 13:48:30.016 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.019 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.111, 2882] 2025-09-16 13:48:30.019 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.020 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.020 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:48:30.021 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.022 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:48:30.022 INFO 9 --- [pool-12-thread-9,461f5c5fb5f798a6,1ca1037ffaa146f5] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching cluster sql stat 2025-09-16 13:48:30.023 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.104, 2882] 2025-09-16 13:48:30.024 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.026 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:48:30.026 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.85, 2882] 2025-09-16 13:48:30.027 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:48:30.027 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.027 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.027 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:48:30.027 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:48:30.028 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:48:30.029 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.54, 2882] 2025-09-16 13:48:30.029 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:30.029 INFO 9 --- [ocp-schedules-6,3fee5e5b534667fb,c9b4d8197e3991d0] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:48:30.029 INFO 9 --- [ocp-schedules-6,3fee5e5b534667fb,c9b4d8197e3991d0] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:48:30.030 INFO 9 --- [ocp-schedules-26,e67dffb7055755d3,4172a7dd69da21c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Check root service executed completed, allCount=1, successCount=1 2025-09-16 13:48:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.031 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:48:30.032 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:48:30.033 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:48:30.033 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:48:30.034 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:48:30.034 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:48:30.035 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:48:30.037 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:48:30.039 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.039 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:48:30.040 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:48:30.041 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:48:30.043 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.044 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:48:30.046 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:30.047 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:30.047 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:30.049 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:30.051 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:30.052 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:48:30.053 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.053 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:48:30.058 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.059 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:48:30.061 INFO 9 --- [ocp-schedules-14,37f745ee0bf72410,85e8c41e686aa2e2] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:48:30.066 WARN 9 --- [scanner-1365880-1,37f745ee0bf72410,2fc4673c56bd5f0e] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:48:30.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:48:30.074 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:48:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.075 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:48:30.075 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:48:30.078 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:48:30.078 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:48:30.078 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:48:30.079 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:30.082 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:48:30.082 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:48:30.083 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:48:30.083 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:48:30.088 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:48:30.088 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:48:30.092 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:48:30.093 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:48:30.099 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.100 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:48:30.100 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.100 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:30.101 INFO 9 --- [prometheus-second-schedule-1,a2e04712b8e66e35,ce2b38ceb9562c1a] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:48:30.102 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:30.103 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:48:30.103 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:30.104 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.104 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.105 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:48:30.105 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:48:30.105 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:30.106 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:30.107 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:30.108 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:48:30.108 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get deadlock of zhengqi 2025-09-16 13:48:30.110 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.111 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:48:30.118 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.118 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:30.123 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:48:30.129 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.130 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:48:30, 2025-09-16 13:48:30] 2025-09-16 13:48:30.130 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:48:30.131 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:48:30.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:30.133 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:48:30.133 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:48:30.135 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:48:30.136 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:48:30.138 INFO 9 --- [host-check-host-status3,883a307d970f16b5,0d5108e66a92dfca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:48:30.138 INFO 9 --- [host-check-host-status5,883a307d970f16b5,3094fb009d2203d9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:48:30.138 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.140 INFO 9 --- [host-check-host-status4,883a307d970f16b5,b19c9a8d72829d68] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:48:30.140 INFO 9 --- [host-check-host-status2,883a307d970f16b5,ad6845ebf8a1b871] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:48:30.140 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:48:30.142 INFO 9 --- [host-check-host-status1,883a307d970f16b5,feb3cef5082d4280] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:48:30.142 INFO 9 --- [host-check-host-status6,883a307d970f16b5,7521a0f4930dfadd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:48:30.147 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:48:30.149 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:30.150 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:48:30, 2025-09-16 13:48:30] 2025-09-16 13:48:30.155 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:48:30.003732+08:00 2025-09-16 13:48:30.156 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:48:30.158 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.159 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:48:30.162 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.163 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.163 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:30.163 INFO 9 --- [ForkJoinPool-10-worker-13,461f5c5fb5f798a6,206860ad3460bc15] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:48:30.166 INFO 9 --- [pool-12-thread-11,461f5c5fb5f798a6,95244e51f90df7e6] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2025-09-16 13:48:30.169 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:48:30.170 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.171 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:48:30, 2025-09-16 13:48:30] 2025-09-16 13:48:30.175 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.p.o.i.OasSessionStatServiceImpl : finish fetching tenant session data of zhengqi 2025-09-16 13:48:30.175 INFO 9 --- [ForkJoinPool-10-worker-6,461f5c5fb5f798a6,5a0fb88a2e78e4e4] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching tenant session stat of zhengqi 2025-09-16 13:48:30.175 INFO 9 --- [pool-12-thread-12,461f5c5fb5f798a6,bde3c2d9fc40a9a6] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2025-09-16 13:48:30.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.179 INFO 9 --- [ocp-async-8,dc96265617500ff0,b528a65cb849d38e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:48:30.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:30.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:30.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.209 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:48:30.223 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.223 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:48:30.239 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:48:30.253 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:30.254 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.255 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:30.260 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:48:30.263 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:48:30.264 INFO 9 --- [ocp-schedules-5,72609cf3b00437da,554448ad2bf672b0] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:48:30.265 INFO 9 --- [ocp-schedules-5,72609cf3b00437da,554448ad2bf672b0] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:30.265 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:48:30.265 INFO 9 --- [ocp-schedules-5,72609cf3b00437da,554448ad2bf672b0] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:48:30.267 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:30.268 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:30.268 INFO 9 --- [ocp-schedules-18,a8637e7e0a8c5f9a,e5ce071c8d4578ed] c.o.o.s.common.scheduled.HostSchedules : Check host version schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:30.268 INFO 9 --- [ocp-schedules-18,a8637e7e0a8c5f9a,e5ce071c8d4578ed] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-version, skip execute 2025-09-16 13:48:30.281 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:48:30.341 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:48:30.355 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:30.356 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:30.357 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:48:30.372 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:48:30.372 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:48:30.372 INFO 9 --- [ocp-schedules-28,bc793b8b935f2a12,c2de04c4a075a0b8] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:48:30.390 INFO 9 --- [ocp-schedules-27,ae24ee45d4446804,950e0caeae4a29b6] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:48:30.429 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:30.430 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:30.565 INFO 9 --- [ocp-schedules-13,75ea9933734fac39,90eccd5383866c7c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:48:30.567 INFO 9 --- [ocp-schedules-13,75ea9933734fac39,90eccd5383866c7c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:48:30.568 INFO 9 --- [ocp-schedules-13,75ea9933734fac39,90eccd5383866c7c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:48:30.770 WARN 9 --- [ocp-async-6,d4d92d325bb43f91,45e328113e5e241d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:30.770 INFO 9 --- [ocp-async-1,b1fb22c93387c667,36080bdcc9c976b5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:30.821 INFO 9 --- [ocp-schedules-1,ecb368ca4af9f38b,f7570737dc6d3aa7] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:48:30.957 INFO 9 --- [ocp-schedules-20,fd251939fe3272d2,0fbd284217b2ab87] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:48:30.957 INFO 9 --- [ocp-schedules-20,fd251939fe3272d2,0fbd284217b2ab87] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:48:31.428 INFO 9 --- [ocp-schedules-9,6e86516ca17d170f,3b70378f0ac0612b] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:48:31.428 INFO 9 --- [ocp-schedules-9,6e86516ca17d170f,3b70378f0ac0612b] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001711 2025-09-16 13:48:31.428 INFO 9 --- [ocp-schedules-9,6e86516ca17d170f,3b70378f0ac0612b] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:48:31.604 INFO 9 --- [ocp-schedules-5,1dbd5c87e2419f27,9fdbdffe3e0a8821] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:48:31.636 INFO 9 --- [prometheus-minute-schedule-1,290499784a3cfd78,d355378d9c366811] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:31.639 INFO 9 --- [prometheus-minute-schedule-1,290499784a3cfd78,d355378d9c366811] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:31.657 INFO 9 --- [ocp-schedules-16,5e4297d0b12a3890,0a40fd37ca4826dd] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:48:31.676 INFO 9 --- [ocp-schedules-28,eabaacc19c6c22c0,ada7a91d3c8b6bee] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:48:31.676 INFO 9 --- [ocp-schedules-28,eabaacc19c6c22c0,ada7a91d3c8b6bee] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:48:31.677 INFO 9 --- [ocp-schedules-28,eabaacc19c6c22c0,ada7a91d3c8b6bee] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:48:31.677 INFO 9 --- [ocp-schedules-28,eabaacc19c6c22c0,ada7a91d3c8b6bee] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:48:31.677 INFO 9 --- [ocp-schedules-28,eabaacc19c6c22c0,ada7a91d3c8b6bee] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:48:31.677 INFO 9 --- [ocp-schedules-28,eabaacc19c6c22c0,ada7a91d3c8b6bee] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:48:31.719 INFO 9 --- [ocp-schedules-27,ab588ba42663e133,21234cca0a5a23a3] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:48:31.720 INFO 9 --- [ocp-schedules-27,ab588ba42663e133,21234cca0a5a23a3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:31.734 INFO 9 --- [ocp-schedules-27,ab588ba42663e133,21234cca0a5a23a3] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:48:32.004 INFO 9 --- [ocp-schedules-3,0fbbec1629fcc1e0,c6791dd0cbc09675] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster system event. 2025-09-16 13:48:32.005 INFO 9 --- [ocp-schedules-3,0fbbec1629fcc1e0,c6791dd0cbc09675] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:32.032 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:32.035 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) ocp_query */ timestamp as gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, rs_svr_ip, rs_svr_port FROM DBA_OB_ROOTSERVICE_EVENT_HISTORY WHERE 1=1 AND timestamp > :startTime AND timestamp <= :endTime AND ( not (module = "balancer" AND event IN ("start_sql_bkgd_task","finish_sql_bkgd_task")) AND not (module = "schema_recycler")) ORDER BY timestamp ASC LIMIT :limit, args: [2025-09-16 10:42:23.324905, 2025-09-16 13:48:32.009, 1000] 2025-09-16 13:48:32.036 INFO 9 --- [Sync system event1,,] .o.o.o.i.c.ClusterSystemEventServiceImpl : Finished sync system events: cluster 1, startTime 2025-09-16 10:42:23.324905, endTime 2025-09-16 13:48:32.009 2025-09-16 13:48:32.052 INFO 9 --- [Sync system event1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:32.056 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:32.071 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) ocp_query */ timestamp as gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, svr_ip, svr_port FROM DBA_OB_SERVER_EVENT_HISTORY WHERE 1=1 AND timestamp > :startTime AND timestamp <= :endTime AND ( (module = "sql") OR (module = "daily_merge") OR (module = "election") OR (module = "physical_restore") OR (module = "observice") OR (module = "observer") OR (module = "clog_restore") OR (module = "warmup") OR (module = "log_archive") OR (module = "archive_log") OR (module = "minor_merge") OR (module = "ddl" AND event IN ("create_partition","batch_create_partition","add_replica","remove_member","batch_remove_member","batch_modify_quorum","batch_change_replica","migrate_replica","remove_replica","rebuild_replica")) OR (module = "freeze" AND event IN ("do minor freeze fail")) OR (module = "storage" AND event IN ("add_replica failed","migrate_replica failed","reubild_replica failed","change_replica failed","log is new enough, turn off rebuild flag","remove_replica failed","restore follower replica failed","restore_replica failed","batch change_replica failed","copy global index failed","restore_standby_replica failed","rebuild_replica failed"))) ORDER BY timestamp ASC LIMIT :limit, args: [2025-09-16 10:43:27.467991, 2025-09-16 13:48:32.039, 1000] 2025-09-16 13:48:32.073 INFO 9 --- [Sync system event1,,] .o.o.o.i.c.ClusterSystemEventServiceImpl : Finished sync server events: cluster 1, startTime 2025-09-16 10:43:27.467991, endTime 2025-09-16 13:48:32.039 2025-09-16 13:48:32.073 INFO 9 --- [ocp-schedules-3,0fbbec1629fcc1e0,c6791dd0cbc09675] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync system event executed completed, allCount=1, successCount=1 2025-09-16 13:48:32.770 WARN 9 --- [ocp-async-8,32014803066b74da,5c7b5aa909e64081] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:32.770 INFO 9 --- [ocp-async-7,54b99eb962f70cc6,5df21ac79b62319b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:32.805 INFO 9 --- [ocp-schedules-22,f25ffc6a1065154a,de17c4e8d0e0f08d] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2025-09-16 13:48:32.805 INFO 9 --- [ocp-schedules-22,f25ffc6a1065154a,de17c4e8d0e0f08d] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2025-09-16 13:48:32.820 INFO 9 --- [pool-69-thread-1,f25ffc6a1065154a,535d962e51c0a07e] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect mini compaction info 2025-09-16 13:48:32.842 INFO 9 --- [pool-69-thread-1,f25ffc6a1065154a,535d962e51c0a07e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:32.845 INFO 9 --- [pool-69-thread-1,f25ffc6a1065154a,535d962e51c0a07e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, MIN(unix_timestamp(`start_time`)*1000000) AS min_start_time, MAX(unix_timestamp(`finish_time`)*1000000) AS max_finish_time, SUM(occupy_size) AS occupy_size, SUM(total_row_count) AS total_row_count, COUNT(1) AS tablet_count FROM GV$OB_TABLET_COMPACTION_HISTORY WHERE type = 'MINI_MERGE' AND unix_timestamp(`finish_time`)*1000000 > ? AND unix_timestamp(`finish_time`)*1000000 <= ? GROUP BY tenant_id;, args: [1758001412000000, 1758001712000000] 2025-09-16 13:48:32.864 INFO 9 --- [pool-69-thread-1,f25ffc6a1065154a,535d962e51c0a07e] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect mini compaction info 2025-09-16 13:48:32.865 INFO 9 --- [ocp-schedules-22,f25ffc6a1065154a,de17c4e8d0e0f08d] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2025-09-16 13:48:33.334 INFO 9 --- [ocp-schedules-27,b149293ee18d658f,23ebd695f399330b] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:48:33.430 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:33.431 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:33.461 INFO 9 --- [ocp-schedules-3,a087d5d45aacb4c3,cb45da27efbe170f] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:48:33.461+08:00, clusters=[1] 2025-09-16 13:48:33.463 INFO 9 --- [ocp-schedules-3,a087d5d45aacb4c3,cb45da27efbe170f] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:48:34.019 INFO 9 --- [ocp-schedules-26,39eab460278db865,8c342c4e8ab8681a] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:48:34.019 INFO 9 --- [ocp-schedules-26,39eab460278db865,8c342c4e8ab8681a] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:48:34.020 INFO 9 --- [ocp-schedules-26,39eab460278db865,8c342c4e8ab8681a] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:48:34.035 INFO 9 --- [ocp-schedules-26,39eab460278db865,8c342c4e8ab8681a] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:48:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:48:34.524 INFO 9 --- [ocp-schedules-25,3ceff1c046044374,c7e031e5c8eeb040] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:48:34.529 INFO 9 --- [ocp-schedules-25,3ceff1c046044374,c7e031e5c8eeb040] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:48:34.529 INFO 9 --- [ocp-schedules-25,3ceff1c046044374,c7e031e5c8eeb040] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:48:34.539 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2025-09-16 13:48:34.549 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:34.550 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:34.563 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:34.564 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:34.577 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:34.578 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:34.591 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:34.591 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:34.605 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:34.606 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:34.619 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:34.619 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:34.632 INFO 9 --- [ocp-schedules-13,8f6523c2df9e5bc0,3f1fc8e145b9569f] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper finished, credentialSize=6, cachedSize=6 2025-09-16 13:48:34.636 INFO 9 --- [prometheus-minute-schedule-1,0433a1072bc73f29,da1ee52a6ec4f7cd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:34.639 INFO 9 --- [prometheus-minute-schedule-1,0433a1072bc73f29,da1ee52a6ec4f7cd] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:34.649 INFO 9 --- [ocp-schedules-9,2938ffa50936d4c1,edfc6f4a63109edf] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:48:34.771 WARN 9 --- [ocp-async-9,926d3ac3e690ffe5,fa3dea0869785763] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:34.771 INFO 9 --- [ocp-async-2,02249340c47f945d,6973d44656de08fb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:35.496 INFO 9 --- [ocp-schedules-26,21e8e84fa8ad1d2f,bb537dfab218f693] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:48:35.496+08:00, clusters=[1] 2025-09-16 13:48:35.500 INFO 9 --- [ocp-schedules-26,21e8e84fa8ad1d2f,bb537dfab218f693] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:48:36.431 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:36.431 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:36.771 WARN 9 --- [ocp-async-3,ac2fd8b75abc934e,5004bc03e0a4c3f4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:36.771 INFO 9 --- [ocp-async-6,da2ee42bce3dc2b8,58f0248f3090389d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:37.594 INFO 9 --- [ocp-schedules-28,b6151f5b0e7d369a,2851bcb2443ed982] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:48:37.595 INFO 9 --- [ocp-schedules-28,b6151f5b0e7d369a,2851bcb2443ed982] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:37.617 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:37.618 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:48:37.630 INFO 9 --- [ocp-schedules-28,b6151f5b0e7d369a,2851bcb2443ed982] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:48:37.636 INFO 9 --- [prometheus-minute-schedule-1,46642de5d17c5e61,9dfff54f8f61c3f8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:37.639 INFO 9 --- [prometheus-minute-schedule-1,46642de5d17c5e61,9dfff54f8f61c3f8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:38.771 WARN 9 --- [ocp-async-1,4796ad39dfcb6757,4e1dc3478d0b2fa3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:38.771 INFO 9 --- [ocp-async-8,ec192c65ca3cf6d9,c19f5cb75ea68cc9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:38.822 INFO 9 --- [ocp-schedules-26,67e309f529ddbefe,db5dfb534ef62a7c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:48:38.824 INFO 9 --- [ocp-schedules-26,67e309f529ddbefe,db5dfb534ef62a7c] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:48:39.415 INFO 9 --- [ocp-schedules-22,793340ba5f0b259d,f413a0bc7beb33a9] c.o.o.m.service.SeriesIdCleanService : Clean series by list started. 2025-09-16 13:48:39.416 INFO 9 --- [ocp-schedules-22,793340ba5f0b259d,f413a0bc7beb33a9] c.o.o.m.service.SeriesIdCleanService : Clean series by list finished. 2025-09-16 13:48:39.416 INFO 9 --- [ocp-schedules-22,793340ba5f0b259d,f413a0bc7beb33a9] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache started, seriesIdKeySize=16768 2025-09-16 13:48:39.431 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:39.432 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:39.607 INFO 9 --- [ocp-schedules-9,98552e27c590bc68,b7c26826df07060b] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:48:39.607 INFO 9 --- [ocp-schedules-9,98552e27c590bc68,b7c26826df07060b] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:48:39.613 INFO 9 --- [ocp-schedules-11,b0cade022168f5b3,b6a7bd5ddc2fba54] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:39.613 INFO 9 --- [ocp-schedules-11,b0cade022168f5b3,b6a7bd5ddc2fba54] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:48:39.613 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:48:39.613 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:48:39.613 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:48:39.613 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:48:39.616 INFO 9 --- [ocp-schedules-11,b0cade022168f5b3,b6a7bd5ddc2fba54] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:39.617 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:39.617 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:39.617 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:39.617 INFO 9 --- [ocp-schedules-11,b0cade022168f5b3,b6a7bd5ddc2fba54] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:39.617 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:39.618 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:39.618 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:39.618 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:39.618 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:39.623 INFO 9 --- [Collect all tenants major compactions1,98552e27c590bc68,64d882333d6ffaf2] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:48:39.623 INFO 9 --- [Collect all tenants major compactions2,98552e27c590bc68,5d04dbb577f08c94] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:48:39.623 INFO 9 --- [Collect all tenants major compactions3,98552e27c590bc68,c4df0af24f47ada3] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:48:39.632 INFO 9 --- [ocp-schedules-11,b0cade022168f5b3,b6a7bd5ddc2fba54] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:48:39.632 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:48:39.634 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:48:39.634 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:48:39.634 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:48:39.634 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:48:39.638 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:39.639 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:39.640 INFO 9 --- [Collect all tenants major compactions1,98552e27c590bc68,64d882333d6ffaf2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:39.640 INFO 9 --- [Collect all tenants major compactions3,98552e27c590bc68,c4df0af24f47ada3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:39.641 INFO 9 --- [Collect all tenants major compactions2,98552e27c590bc68,5d04dbb577f08c94] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:39.641 INFO 9 --- [Collect all tenants major compactions1,98552e27c590bc68,64d882333d6ffaf2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:48:39.641 INFO 9 --- [Collect all tenants major compactions3,98552e27c590bc68,c4df0af24f47ada3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:48:39.642 INFO 9 --- [Collect all tenants major compactions2,98552e27c590bc68,5d04dbb577f08c94] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:48:39.644 INFO 9 --- [Collect all tenants major compactions3,98552e27c590bc68,c4df0af24f47ada3] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:48:39.645 INFO 9 --- [Collect all tenants major compactions2,98552e27c590bc68,5d04dbb577f08c94] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:48:39.646 INFO 9 --- [Collect all tenants major compactions1,98552e27c590bc68,64d882333d6ffaf2] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:48:39.646 INFO 9 --- [ocp-schedules-9,98552e27c590bc68,b7c26826df07060b] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:48:39.652 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:48:39.654 INFO 9 --- [ocp-schedules-11,b0cade022168f5b3,b6a7bd5ddc2fba54] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:48:39.938 INFO 9 --- [ocp-schedules-22,793340ba5f0b259d,f413a0bc7beb33a9] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache ended, seriesIdKeySize=16768 2025-09-16 13:48:40.002 INFO 9 --- [ocp-schedules-6,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:48:40.002 INFO 9 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:48:40.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:48:40.003079+08:00, lastProcessTime=2025-09-16T13:48:30.003732+08:00 2025-09-16 13:48:40.102 INFO 9 --- [ocp-schedules-21,b7b9d7825ebd0949,63fd48247cea5302] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:48:40.110 WARN 9 --- [scanner-1366004-1,b7b9d7825ebd0949,c193221e582b1061] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:48:40.120 INFO 9 --- [alarm-detect-12,b7b9d7825ebd0949,25b29442e927af9a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:48:40.123 INFO 9 --- [alarm-detect-19,b7b9d7825ebd0949,678c7dfdb4037069] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:48:40.123 INFO 9 --- [alarm-detect-3,b7b9d7825ebd0949,2115c41548f69709] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:48:40.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:48:40.003079+08:00 2025-09-16 13:48:40.135 INFO 9 --- [alarm-detect-2,b7b9d7825ebd0949,89e789e1e8658d13] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:48:40.179 INFO 9 --- [ocp-async-4,63d97cd72d969d16,3e7f8a186a00e4e2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:48:40.636 INFO 9 --- [prometheus-minute-schedule-1,58b2ca5c31f58e57,9f470d02ed4d5f63] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:40.639 INFO 9 --- [prometheus-minute-schedule-1,58b2ca5c31f58e57,9f470d02ed4d5f63] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:40.771 WARN 9 --- [ocp-async-5,adc4d9a4ac650a06,de302df9fba9ab61] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:40.771 INFO 9 --- [ocp-async-2,b919fec519bcf432,9ed93964e216ddd7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:42.013 INFO 9 --- [ocp-schedules-7,0b2d5da5e99619d5,1eb1edbce3b024ee] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:48:42.013 INFO 9 --- [ocp-schedules-7,0b2d5da5e99619d5,1eb1edbce3b024ee] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:48:42.030 INFO 9 --- [ocp-schedules-7,0b2d5da5e99619d5,1eb1edbce3b024ee] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:48:42.045 INFO 9 --- [ocp-schedules-7,0b2d5da5e99619d5,1eb1edbce3b024ee] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.046 INFO 9 --- [ocp-schedules-7,0b2d5da5e99619d5,1eb1edbce3b024ee] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:48:42.432 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:42.432 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:42.566 INFO 9 --- [ocp-schedules-27,dbcac3a63857e87b,e8da506ccc143075] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:48:42.568 INFO 9 --- [ocp-schedules-27,dbcac3a63857e87b,e8da506ccc143075] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:42.613 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:48:42.614 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.616 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:48:42.637 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.638 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:48:42.661 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.662 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:48:42.685 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.686 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:48:42.690 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.691 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:48:42.712 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.712 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:48:42.736 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.736 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:48:42.741 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.741 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:48:42.763 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.764 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:48:42.771 WARN 9 --- [ocp-async-4,226ce8f53176498e,e7d1aa6c2d25be54] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:42.771 INFO 9 --- [ocp-async-6,f713717dd51edb07,fa97a00eaf402c80] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:42.787 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.788 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:48:42.805 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.806 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:48:42.807 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.808 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:48:42.808 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.809 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:48:42.810 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.810 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:48:42.811 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.812 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:48:42.812 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.813 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:48:42.830 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.830 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:48:42.831 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.832 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:48:42.832 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.833 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:48:42.849 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:48:42.851 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:48:42.877 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:48:42.878 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:42.879 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:48:42.908 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:48:42.908 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:48:42.908 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:48:42.908 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:48:42.908 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:48:42.908 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:48:42.910 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:48:42.910 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:48:42.910 INFO 9 --- [ocp-schedules-27,dbcac3a63857e87b,e8da506ccc143075] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:48:43.636 INFO 9 --- [prometheus-minute-schedule-1,dd29ef84968b1ceb,859488975f05b1f2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:43.640 INFO 9 --- [prometheus-minute-schedule-1,dd29ef84968b1ceb,859488975f05b1f2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 13:48:43,902 |-INFO in ReconfigureOnChangeTask(born:1758001603902) - Empty watch file list. Disabling 2025-09-16 13:48:44.652 INFO 9 --- [ocp-schedules-13,0b88e7bc0ca56a64,944c879ddb904382] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:48:44.771 INFO 9 --- [ocp-async-10,704104f20ff879f2,94283eed7b7bd46d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:44.771 WARN 9 --- [ocp-async-8,8da618d7f6227887,a5c8a930282b79db] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:45.432 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:45.433 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:46.636 INFO 9 --- [prometheus-minute-schedule-1,05e6022c4d9d9c87,e8c98b547c75f3a6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:46.639 INFO 9 --- [prometheus-minute-schedule-1,05e6022c4d9d9c87,e8c98b547c75f3a6] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:46.771 INFO 9 --- [ocp-async-9,164f338bae2d0bd9,eeb2ff85afb90b06] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:46.771 WARN 9 --- [ocp-async-3,8f50eebe558ac42e,0a7a6128b36d2c84] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:48.433 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:48.433 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:48.771 INFO 9 --- [ocp-async-2,bbeb8b9c92c38b74,43b203e678b0a98f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:48.771 WARN 9 --- [ocp-async-4,2e26dc4efeca0eef,16ad58b5638b694f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:48.829 INFO 9 --- [ocp-schedules-4,f4151b5e35b714be,09bc7d48d8a78102] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:48:48.831 INFO 9 --- [ocp-schedules-4,f4151b5e35b714be,09bc7d48d8a78102] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:48:49.223 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:48:49.237 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:48:49.250 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:48:49.250 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:48:49.250 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:48:49.250 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:48:49.250 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:48:49.253 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.253 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.253 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.253 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.253 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.254 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:49.254 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:49.254 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:49.254 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:49.255 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:49.255 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.255 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.255 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.255 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.255 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:48:49.256 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:48:49.256 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:48:49.256 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:48:49.256 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:49.257 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:48:49.276 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:46:30, start=2025-09-16T13:42:30, end=2025-09-16T13:45:00, updates=86, granule=120000ms, delay=240000ms 2025-09-16 13:48:49.276 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:46:30, start=2025-09-16T13:42:30, end=2025-09-16T13:45:00, updates=86, granule=120000ms, delay=240000ms 2025-09-16 13:48:49.280 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:46:30, target=2025-09-16T13:45:00, granule=120000ms, delay=90000ms) 2025-09-16 13:48:49.280 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:45:00, target=2025-09-16T13:37:30, granule=600000ms, delay=450000ms) 2025-09-16 13:48:49.280 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:46:30, target=2025-09-16T13:45:00, granule=120000ms, delay=90000ms) 2025-09-16 13:48:49.280 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:45:00, target=2025-09-16T13:37:30, granule=600000ms, delay=450000ms) 2025-09-16 13:48:49.284 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:46:30, start=2025-09-16T13:42:30, end=2025-09-16T13:45:00, updates=157, granule=120000ms, delay=240000ms 2025-09-16 13:48:49.286 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:46:30, start=2025-09-16T13:42:30, end=2025-09-16T13:45:00, updates=197, granule=120000ms, delay=240000ms 2025-09-16 13:48:49.290 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:46:30, target=2025-09-16T13:45:00, granule=120000ms, delay=90000ms) 2025-09-16 13:48:49.290 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:46:30, target=2025-09-16T13:45:00, granule=120000ms, delay=90000ms) 2025-09-16 13:48:49.290 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:46:30, start=2025-09-16T13:42:30, end=2025-09-16T13:45:00, updates=214, granule=120000ms, delay=240000ms 2025-09-16 13:48:49.290 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:45:00, target=2025-09-16T13:37:30, granule=600000ms, delay=450000ms) 2025-09-16 13:48:49.290 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:45:00, target=2025-09-16T13:37:30, granule=600000ms, delay=450000ms) 2025-09-16 13:48:49.294 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:46:30, target=2025-09-16T13:45:00, granule=120000ms, delay=90000ms) 2025-09-16 13:48:49.294 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:45:00, target=2025-09-16T13:37:30, granule=600000ms, delay=450000ms) 2025-09-16 13:48:49.294 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=71ms, period=120000ms 2025-09-16 13:48:49.636 INFO 9 --- [prometheus-minute-schedule-1,fe8d10d649b93b5e,ea5e73f6af35f77c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:49.639 INFO 9 --- [prometheus-minute-schedule-1,fe8d10d649b93b5e,ea5e73f6af35f77c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:48:50.004317+08:00, lastProcessTime=2025-09-16T13:48:40.003079+08:00 2025-09-16 13:48:50.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:48:50.004317+08:00 2025-09-16 13:48:50.138 INFO 9 --- [ocp-schedules-1,4555e577e3483acd,5a0fe5947b203a24] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:48:50.142 WARN 9 --- [scanner-1366166-1,4555e577e3483acd,27fdeba4b3f1ab95] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:48:50.179 INFO 9 --- [ocp-async-3,562496d88447d8d2,cc2bac4141f65703] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:48:50.772 WARN 9 --- [ocp-async-8,a6d9d709d86ab38a,28a6b7f3de46339d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:50.772 INFO 9 --- [ocp-async-7,81ed854ae99989d5,ab9e71614dde0466] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:51.433 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:51.434 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:52.636 INFO 9 --- [prometheus-minute-schedule-1,564b3f912bd37508,55b72f14eee30398] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:52.639 INFO 9 --- [prometheus-minute-schedule-1,564b3f912bd37508,55b72f14eee30398] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:52.772 WARN 9 --- [ocp-async-3,a0121f3f6f017654,f00ff4ac0830e7f6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:52.772 INFO 9 --- [ocp-async-5,9801f365c9cce04d,48913b497104dbf5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:53.556 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,dbd9ab2cd212d8f4,22c68d9a9753ca03] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=dbd9ab2cd212d8f4, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:48:53.557 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,dbd9ab2cd212d8f4,22c68d9a9753ca03] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=dbd9ab2cd212d8f4, duration=1 ms] 2025-09-16 13:48:54.434 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:54.435 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:54.531 INFO 9 --- [ocp-schedules-8,3a6466886d9ce01e,393bd3384621ab42] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:48:54.536 INFO 9 --- [ocp-schedules-8,3a6466886d9ce01e,393bd3384621ab42] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:48:54.536 INFO 9 --- [ocp-schedules-8,3a6466886d9ce01e,393bd3384621ab42] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:48:54.655 INFO 9 --- [ocp-schedules-5,4aec2fe3e68facd3,4679a8531bf3fa0e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:48:54.772 WARN 9 --- [ocp-async-4,3d9bfb85ca7a6fbc,e6482ff64fef4568] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:54.772 INFO 9 --- [ocp-async-1,49991c32af737e4c,6f2c9c7f447c2d59] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:55.636 INFO 9 --- [prometheus-minute-schedule-1,9b3ad5548ffa243e,5b3d90552f4d3d3e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:55.639 INFO 9 --- [prometheus-minute-schedule-1,9b3ad5548ffa243e,5b3d90552f4d3d3e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:56.772 WARN 9 --- [ocp-async-6,ae6f56cc73131e9d,4deb4ea034d124e9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:56.772 INFO 9 --- [ocp-async-8,ad022d65186d7305,b1850756658a1715] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:57.435 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:48:57.435 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:48:58.636 INFO 9 --- [prometheus-minute-schedule-1,6af66e619ddb758d,92f0054bd9cace2c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001740, interval=60 2025-09-16 13:48:58.639 INFO 9 --- [prometheus-minute-schedule-1,6af66e619ddb758d,92f0054bd9cace2c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:48:58.772 WARN 9 --- [ocp-async-7,89f38639b7a99cbb,82dcfb049afbb318] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:48:58.772 INFO 9 --- [ocp-async-3,8df1dae0feb20bf4,7e65286b0763d17d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:48:58.835 INFO 9 --- [ocp-schedules-22,42e4de0f2e05ccec,9de101d1aa9025cf] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:48:58.837 INFO 9 --- [ocp-schedules-22,42e4de0f2e05ccec,9de101d1aa9025cf] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:48:59.938 INFO 9 --- [ocp-schedules-6,4c3e211ee43f0bf0,ef447b0babf20c58] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:48:59.941 INFO 9 --- [ocp-schedules-2,b0add658e8d0a1ed,da6f37c47674c93b] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:48:59.941 INFO 9 --- [ocp-schedules-12,0f3a3ab20e8ce020,8100681a62bb8adf] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:48:59.942 INFO 9 --- [ocp-schedules-25,7f9f259d08d7c517,ec05372873020dd3] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:48:59.943 INFO 9 --- [ocp-schedules-2,b0add658e8d0a1ed,da6f37c47674c93b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:59.943 INFO 9 --- [ocp-schedules-12,0f3a3ab20e8ce020,8100681a62bb8adf] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:59.943 INFO 9 --- [ocp-schedules-25,7f9f259d08d7c517,ec05372873020dd3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:48:59.944 INFO 9 --- [ocp-schedules-25,7f9f259d08d7c517,ec05372873020dd3] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:48:59.944 INFO 9 --- [ocp-schedules-13,3241fe0839cc20d5,7c6815c8cbeeede1] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:59.944 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:48:59.944 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:48:59.944 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:48:59.944 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:48:59.944 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:48:59.944 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:48:59.945 INFO 9 --- [ocp-schedules-4,4a7d90ba4c912f74,d1b6b9411a0851bf] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:59.945 INFO 9 --- [host-check-agent-status1,4a7d90ba4c912f74,b3ca5cc3c6928aa0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:48:59.945 INFO 9 --- [host-check-agent-status2,4a7d90ba4c912f74,fa5cd9acd68f5e48] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:48:59.945 INFO 9 --- [host-check-agent-status3,4a7d90ba4c912f74,0bcd9daa4a075a30] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:48:59.945 INFO 9 --- [host-check-agent-status4,4a7d90ba4c912f74,6665e16cd578a84a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:48:59.945 INFO 9 --- [host-check-agent-status5,4a7d90ba4c912f74,f52cb161b8f272d1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:48:59.945 INFO 9 --- [host-check-agent-status6,4a7d90ba4c912f74,56beb2ceeaf13348] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:48:59.945 INFO 9 --- [ocp-schedules-18,2b2b43d033177fed,b7d83d8468b62e4c] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:48:59.945 INFO 9 --- [host-check-clockdiff1,2b2b43d033177fed,3c21ab00a9b4002e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:48:59.945 INFO 9 --- [host-check-clockdiff2,2b2b43d033177fed,bf26e71b7e5079b1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:48:59.946 INFO 9 --- [host-check-clockdiff3,2b2b43d033177fed,becead4d7d3155c5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:48:59.946 INFO 9 --- [host-check-clockdiff4,2b2b43d033177fed,592fdc75ec016f17] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:48:59.946 INFO 9 --- [host-check-clockdiff5,2b2b43d033177fed,656af32afb4b60e5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:48:59.946 INFO 9 --- [host-check-clockdiff6,2b2b43d033177fed,8088a943e830c72a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:48:59.948 INFO 9 --- [ocp-schedules-23,9786f43f8e54adc0,9c0436a301003b0c] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:48:59.951 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:59.952 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:59.953 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:59.954 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:59.954 INFO 9 --- [host-check-agent-status1,4a7d90ba4c912f74,b3ca5cc3c6928aa0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:59.954 INFO 9 --- [host-check-agent-status4,4a7d90ba4c912f74,6665e16cd578a84a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:59.954 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:59.954 INFO 9 --- [host-check-clockdiff1,2b2b43d033177fed,3c21ab00a9b4002e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001739 -1 -1 , error= 2025-09-16 13:48:59.954 INFO 9 --- [host-check-clockdiff3,2b2b43d033177fed,becead4d7d3155c5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001739 -1 -1 , error= 2025-09-16 13:48:59.955 INFO 9 --- [host-check-agent-status3,4a7d90ba4c912f74,0bcd9daa4a075a30] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:59.955 INFO 9 --- [host-check-agent-status5,4a7d90ba4c912f74,f52cb161b8f272d1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:59.955 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:59.955 INFO 9 --- [host-check-agent-status2,4a7d90ba4c912f74,fa5cd9acd68f5e48] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:59.955 INFO 9 --- [host-check-clockdiff5,2b2b43d033177fed,656af32afb4b60e5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001739 -1 -1 , error= 2025-09-16 13:48:59.955 INFO 9 --- [host-check-clockdiff4,2b2b43d033177fed,592fdc75ec016f17] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001739 -1 -1 , error= 2025-09-16 13:48:59.955 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:59.956 INFO 9 --- [host-check-agent-status6,4a7d90ba4c912f74,56beb2ceeaf13348] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:59.956 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:59.956 INFO 9 --- [host-check-clockdiff2,2b2b43d033177fed,bf26e71b7e5079b1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001739 -1 -1 , error= 2025-09-16 13:48:59.956 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:59.957 INFO 9 --- [host-check-agent-status3,4a7d90ba4c912f74,0bcd9daa4a075a30] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:59.957 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:59.957 INFO 9 --- [host-check-agent-status5,4a7d90ba4c912f74,f52cb161b8f272d1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:59.957 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:59.957 INFO 9 --- [host-check-agent-status4,4a7d90ba4c912f74,6665e16cd578a84a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:59.957 INFO 9 --- [host-check-agent-status1,4a7d90ba4c912f74,b3ca5cc3c6928aa0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:59.957 INFO 9 --- [host-check-agent-status6,4a7d90ba4c912f74,56beb2ceeaf13348] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:59.957 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:59.957 INFO 9 --- [host-check-agent-status2,4a7d90ba4c912f74,fa5cd9acd68f5e48] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:59.971 INFO 9 --- [host-check-agent-status4,4a7d90ba4c912f74,6665e16cd578a84a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:48:59.971 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:48:59.971 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:48:59.971 INFO 9 --- [host-check-agent-status1,4a7d90ba4c912f74,b3ca5cc3c6928aa0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:48:59.971 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:48:59.972 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:48:59.972 INFO 9 --- [host-check-agent-status5,4a7d90ba4c912f74,f52cb161b8f272d1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:48:59.972 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:48:59.972 INFO 9 --- [host-check-agent-status6,4a7d90ba4c912f74,56beb2ceeaf13348] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:48:59.973 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:48:59.971895751+08:00 2025-09-16 13:48:59.973 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:48:59.972247216+08:00 2025-09-16 13:48:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:59.973 INFO 9 --- [host-check-agent-status2,4a7d90ba4c912f74,fa5cd9acd68f5e48] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:48:59.973 INFO 9 --- [host-check-agent-status3,4a7d90ba4c912f74,0bcd9daa4a075a30] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:48:59.973 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:48:59.973+08:00 2025-09-16 13:48:59.973 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:48:59.973 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:48:59.973+08:00 2025-09-16 13:48:59.974 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:48:59.972767311+08:00 2025-09-16 13:48:59.974 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:48:59.972579513+08:00 2025-09-16 13:48:59.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:48:59.974 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:48:59.973230381+08:00 2025-09-16 13:48:59.974 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:48:59.974+08:00 2025-09-16 13:48:59.974 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:48:59.974+08:00 2025-09-16 13:48:59.975 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:48:59.974+08:00 2025-09-16 13:48:59.975 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:48:59.974390734+08:00 2025-09-16 13:48:59.975 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:48:59.973+08:00 and status AVAILABLE 2025-09-16 13:48:59.975 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:48:59.973+08:00 and status AVAILABLE 2025-09-16 13:48:59.975 INFO 9 --- [host-check-agent-status4,4a7d90ba4c912f74,6665e16cd578a84a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:48:59.975 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:48:59.975+08:00 2025-09-16 13:48:59.975 INFO 9 --- [host-check-agent-status4,4a7d90ba4c912f74,6665e16cd578a84a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:48:59.975 INFO 9 --- [host-check-agent-status4,4a7d90ba4c912f74,6665e16cd578a84a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:48:59.976 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:48:59.974+08:00 and status AVAILABLE 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status6,4a7d90ba4c912f74,56beb2ceeaf13348] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status6,4a7d90ba4c912f74,56beb2ceeaf13348] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status6,4a7d90ba4c912f74,56beb2ceeaf13348] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:48:59.976 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:48:59.974+08:00 and status AVAILABLE 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status3,4a7d90ba4c912f74,0bcd9daa4a075a30] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status3,4a7d90ba4c912f74,0bcd9daa4a075a30] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status3,4a7d90ba4c912f74,0bcd9daa4a075a30] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status1,4a7d90ba4c912f74,b3ca5cc3c6928aa0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status1,4a7d90ba4c912f74,b3ca5cc3c6928aa0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status1,4a7d90ba4c912f74,b3ca5cc3c6928aa0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:48:59.976 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:48:59.974+08:00 and status AVAILABLE 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status5,4a7d90ba4c912f74,f52cb161b8f272d1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status5,4a7d90ba4c912f74,f52cb161b8f272d1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:48:59.976 INFO 9 --- [host-check-agent-status5,4a7d90ba4c912f74,f52cb161b8f272d1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:48:59.977 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:48:59.975+08:00 and status AVAILABLE 2025-09-16 13:48:59.977 INFO 9 --- [host-check-agent-status2,4a7d90ba4c912f74,fa5cd9acd68f5e48] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:48:59.977 INFO 9 --- [host-check-agent-status2,4a7d90ba4c912f74,fa5cd9acd68f5e48] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:48:59.977 INFO 9 --- [host-check-agent-status2,4a7d90ba4c912f74,fa5cd9acd68f5e48] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:48:59.978 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:48:59.978 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:48:59.979 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:48:59.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:48:59.979 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:48:59.979 INFO 9 --- [ocp-schedules-12,0f3a3ab20e8ce020,8100681a62bb8adf] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:48:59.979 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:48:59.980 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:48:59.984 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:48:59.984 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:48:59.984 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:48:59.985 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:48:59.985 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:48:59.985 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:48:59.985 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:48:59.985 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:48:59.985 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:48:59.986 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:48:59.986 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:48:59.986 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:48:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:48:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:48:59.999 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:00.000 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:00.000 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:00.000 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:00.000 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:00.001 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:49:00.004365+08:00, lastProcessTime=2025-09-16T13:48:50.004317+08:00 2025-09-16 13:49:00.027 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:49:00.027 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:49:00.028 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:49:00.029 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:49:00.032 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:49:00.033 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:49:00.033 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:49:00.034 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:49:00.036 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:49:00.036 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:49:00.036 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:00.038 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:00.039 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:49:00.039 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:49:00.039 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:49:00.046 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:00.047 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:00.048 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:00.048 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:00.051 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:00.051 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:00.073 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:49:00.075 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:49:00.076 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:49:00.076 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:00.077 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:49:00.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:00.078 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:49:00.078 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:49:00.078 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:49:00.080 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:49:00.082 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:49:00.082 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:49:00.082 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:00.083 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:49:00.085 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:49:00.086 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:49:00.086 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:49:00.087 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:00.094 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:00.095 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:00.096 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:00.096 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:00.097 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:00.098 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:00.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:00.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:00.122 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:49:00.122 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:49:00.124 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:49:00.124 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:49:00.126 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:49:00.126 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:49:00.128 INFO 9 --- [host-check-host-status3,3241fe0839cc20d5,e1df7ee33f3a6d86] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:49:00.129 INFO 9 --- [host-check-host-status5,3241fe0839cc20d5,4437256e7b6d182f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:49:00.131 INFO 9 --- [host-check-host-status4,3241fe0839cc20d5,b56f5f64e58ccc77] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:49:00.131 INFO 9 --- [host-check-host-status1,3241fe0839cc20d5,ca65016ef40de3eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:49:00.132 INFO 9 --- [host-check-host-status2,3241fe0839cc20d5,eb112e06b484830f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:49:00.133 INFO 9 --- [host-check-host-status6,3241fe0839cc20d5,650f644e25c69060] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:49:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:00.140 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:49:00.004365+08:00 2025-09-16 13:49:00.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.152 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:00.163 INFO 9 --- [ocp-schedules-1,d6d5a600a8a670e8,72437880f4002024] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:49:00.166 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.166 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:00.169 WARN 9 --- [scanner-1366301-1,d6d5a600a8a670e8,cb740e2cb423f548] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:49:00.179 INFO 9 --- [ocp-async-6,0c4004ac371aaf43,16a9a9cbfb5b2e2c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:49:00.179 INFO 9 --- [alarm-detect-5,d6d5a600a8a670e8,613cb3ffebd7f767] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:49:00.181 INFO 9 --- [alarm-detect-10,d6d5a600a8a670e8,80e72b6c4426b6cc] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:49:00.182 INFO 9 --- [alarm-detect-19,d6d5a600a8a670e8,6db53e8c395af624] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:49:00.186 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.186 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:00.195 INFO 9 --- [alarm-detect-6,d6d5a600a8a670e8,fe92532d3dfbb4cf] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:49:00.202 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.202 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:00.216 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.216 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:00.229 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.229 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:00.244 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:00.258 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:00.259 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:00.260 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:49:00.265 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:49:00.267 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:49:00.270 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:00.271 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:00.284 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:49:00.345 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:49:00.359 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:00.360 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:00.361 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:49:00.375 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:49:00.375 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:49:00.375 INFO 9 --- [ocp-schedules-2,b0add658e8d0a1ed,da6f37c47674c93b] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:49:00.435 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:00.436 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:00.772 INFO 9 --- [ocp-async-2,e3f57037ad947b24,f5e54e84d80cd7aa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:00.772 WARN 9 --- [ocp-async-4,5f0fcb4568b344a5,2a54af5848e3df15] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:00.823 INFO 9 --- [ocp-schedules-28,503542b457953e5d,770c4e5d618eb15c] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:49:00.888 INFO 9 --- [host-check-clockdiff6,2b2b43d033177fed,8088a943e830c72a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001740 -1 -1 , error= 2025-09-16 13:49:01.636 INFO 9 --- [prometheus-minute-schedule-1,3f5b6b8c55e068fd,71699f0528fde5ce] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:01.639 INFO 9 --- [prometheus-minute-schedule-1,3f5b6b8c55e068fd,71699f0528fde5ce] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:02.772 INFO 9 --- [ocp-async-6,1d4a742ab89ae483,b0f64747f5d9938c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:02.772 WARN 9 --- [ocp-async-10,6f494eb7348d1180,953d4196259da57c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:03.436 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:03.437 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:04.636 INFO 9 --- [prometheus-minute-schedule-1,fc685aad8dfe2e6e,8544b172ecd12671] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:04.639 INFO 9 --- [prometheus-minute-schedule-1,fc685aad8dfe2e6e,8544b172ecd12671] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:04.659 INFO 9 --- [ocp-schedules-21,9ad95e79cf99f915,a958608e0e6b7c16] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:49:04.772 WARN 9 --- [ocp-async-9,6d259c9d2b825843,bcdb06fd6c4b8344] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:04.772 INFO 9 --- [ocp-async-7,4f3c63d2e1d513ed,c004674031f0ebb2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:06.437 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:06.437 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:06.772 INFO 9 --- [ocp-async-5,08a2e105bd024a0a,7fd53680c25fd3a6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:06.772 WARN 9 --- [ocp-async-4,6733a958674da8cb,30a91cb4fd486e8b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:07.636 INFO 9 --- [prometheus-minute-schedule-1,a8dd655538ae6dd9,90cd623c21f1066f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:07.639 INFO 9 --- [prometheus-minute-schedule-1,a8dd655538ae6dd9,90cd623c21f1066f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:08.773 INFO 9 --- [ocp-async-2,206a66edfe493f49,739935b99420847a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:08.773 WARN 9 --- [ocp-async-10,83ba719f630c3f29,f7caf7ed3cc5ac37] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:08.842 INFO 9 --- [ocp-schedules-14,df5a590e463e28ec,cba44ba967ca060c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:49:08.844 INFO 9 --- [ocp-schedules-14,df5a590e463e28ec,cba44ba967ca060c] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:49:09.438 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:09.438 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:10.002 INFO 9 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:49:10.002 INFO 9 --- [ocp-schedules-21,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:49:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:49:10.003312+08:00, lastProcessTime=2025-09-16T13:49:00.004365+08:00 2025-09-16 13:49:10.124 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:49:10.003312+08:00 2025-09-16 13:49:10.180 INFO 9 --- [ocp-async-4,c02ca5e1a951e52d,9effb0393f719025] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:49:10.197 INFO 9 --- [ocp-schedules-14,f2cc50691a2421d9,d4a686797d9b19cb] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:49:10.202 WARN 9 --- [scanner-1366467-1,f2cc50691a2421d9,b1ef496735d4c269] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:49:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:49:10.636 INFO 9 --- [prometheus-minute-schedule-1,ab2c5b2057b2a916,bbe3452b22985ad3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:10.639 INFO 9 --- [prometheus-minute-schedule-1,ab2c5b2057b2a916,bbe3452b22985ad3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:10.773 INFO 9 --- [ocp-async-9,5f5397d4890e5b22,af00e066b1855f73] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:10.773 WARN 9 --- [ocp-async-3,c548ac97f1f5ece0,d4457ab7b8df5593] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:11.705 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001680, nodeCount=463, affectRows=463 2025-09-16 13:49:12.438 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:12.439 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:12.773 INFO 9 --- [ocp-async-4,92aa2f52edda74e0,201fbf1d039a213a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:12.773 WARN 9 --- [ocp-async-1,d04ce7034038c0ec,9891d68aa4896a87] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:13.636 INFO 9 --- [prometheus-minute-schedule-1,ab2ea9889a59b774,ad83ed3a9ea5a9f1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:13.640 INFO 9 --- [prometheus-minute-schedule-1,ab2ea9889a59b774,ad83ed3a9ea5a9f1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:14.538 INFO 9 --- [ocp-schedules-12,485ccaf12fa7a79d,ea7b67c2fc9cd35e] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:49:14.542 INFO 9 --- [ocp-schedules-12,485ccaf12fa7a79d,ea7b67c2fc9cd35e] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:49:14.542 INFO 9 --- [ocp-schedules-12,485ccaf12fa7a79d,ea7b67c2fc9cd35e] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:49:14.662 INFO 9 --- [ocp-schedules-11,12062179aa6c5a25,c8f31b149df56659] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:49:14.744 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001680, nodeCount=1000, affectRows=1000 2025-09-16 13:49:14.747 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001680, nodeCount=1000, validCount=996 2025-09-16 13:49:14.772 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001680, nodeCount=1000, affectRows=1000 2025-09-16 13:49:14.773 WARN 9 --- [ocp-async-4,b0e7a8d89d4a46ee,c4f402f91b54d8cd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:14.773 INFO 9 --- [ocp-async-10,fbe0ff9f74d4b84c,bda886c7e1470632] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:14.774 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001680, nodeCount=1000, validCount=998 2025-09-16 13:49:14.786 ERROR 9 --- [metric-archive-second-5,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221682509) Duplicate entry '824401952599621632-1758001620' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221682509) Duplicate entry '824401952599621632-1758001620' for key 'PRIMARY' 2025-09-16 13:49:15.439 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:15.440 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:15.450 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001680, nodeCount=853, affectRows=853 2025-09-16 13:49:15.452 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001680, nodeCount=852, validCount=850 2025-09-16 13:49:16.061 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001680, nodeCount=1000, affectRows=1000 2025-09-16 13:49:16.063 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001680, nodeCount=992, validCount=946 2025-09-16 13:49:16.636 INFO 9 --- [prometheus-minute-schedule-1,adb2b7f70ec011da,6dbce9742b49c3c6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:16.639 INFO 9 --- [prometheus-minute-schedule-1,adb2b7f70ec011da,6dbce9742b49c3c6] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:16.773 WARN 9 --- [ocp-async-10,80c9c1984ea14255,12f392899d3ccb98] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:16.773 INFO 9 --- [ocp-async-6,027420f0da3ad4e5,7cb4fd6c6c369994] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:18.440 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:18.440 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:18.773 WARN 9 --- [ocp-async-6,d0ab9b7f55693daa,706294cd4f040060] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:18.773 INFO 9 --- [ocp-async-9,76bb8f03bf8609ad,619784a88c638e2c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:18.848 INFO 9 --- [ocp-schedules-29,1281ed563d5fbd50,c9ecb0047a0cbf45] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:49:18.850 INFO 9 --- [ocp-schedules-29,1281ed563d5fbd50,c9ecb0047a0cbf45] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:49:19.636 INFO 9 --- [prometheus-minute-schedule-1,bd494c95d41ece74,ecade88ce4047ebc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:19.639 INFO 9 --- [prometheus-minute-schedule-1,bd494c95d41ece74,ecade88ce4047ebc] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:49:20.002754+08:00, lastProcessTime=2025-09-16T13:49:10.003312+08:00 2025-09-16 13:49:20.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:49:20.002754+08:00 2025-09-16 13:49:20.180 INFO 9 --- [ocp-async-7,6a6b796642199154,3bfcfea05c728fed] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:49:20.224 INFO 9 --- [ocp-schedules-13,94154f86a477cbd7,7ba1082979882746] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:49:20.229 WARN 9 --- [scanner-1367464-1,94154f86a477cbd7,f4260afcc314510b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:49:20.239 INFO 9 --- [alarm-detect-17,94154f86a477cbd7,2e5fafebe46a988f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:49:20.241 INFO 9 --- [alarm-detect-14,94154f86a477cbd7,d3cb919d02ed34dd] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:49:20.242 INFO 9 --- [alarm-detect-20,94154f86a477cbd7,d3bf389c220f376a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:49:20.254 INFO 9 --- [alarm-detect-17,94154f86a477cbd7,38a21680ce03fd3b] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:49:20.636 INFO 9 --- [prometheus-cache-monitor1,b2e0730ce6b23836,f630be3d42b2c84e] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:49:20.636 INFO 9 --- [prometheus-cache-monitor1,b2e0730ce6b23836,f630be3d42b2c84e] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:49:20.773 WARN 9 --- [ocp-async-8,07fec0a1459be90a,24e9cf8122358a82] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:20.773 INFO 9 --- [ocp-async-2,478a16bc42b72963,94ca37addc80e3e6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:21.440 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:21.441 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:22.636 INFO 9 --- [prometheus-minute-schedule-1,a3c1b2c07f96ed65,228cb61bd4d0e572] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:22.639 INFO 9 --- [prometheus-minute-schedule-1,a3c1b2c07f96ed65,228cb61bd4d0e572] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:22.773 WARN 9 --- [ocp-async-2,66de5885adc89d44,b57d400054e4d849] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:22.773 INFO 9 --- [ocp-async-7,94a948b5acea430f,f076fff05c127b46] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:23.960 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:23.963 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitr 2025-09-16 13:49:23.975 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:23.986 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:23.997 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.007 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.011 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.014 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.017 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.020 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.023 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.026 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.029 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.033 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:23.875, end=2025-09-16T13:48:23.958} 2025-09-16 13:49:24.033 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2025-09-16 13:49:24.441 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:24.442 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:24.665 INFO 9 --- [ocp-schedules-8,a947f5115dee9394,380ab97328d1e0d3] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:49:24.774 WARN 9 --- [ocp-async-7,122cd350dd23363f,d427a80944e7ac94] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:24.774 INFO 9 --- [ocp-async-5,03b9ca92df09b0b1,49d669825cd0738a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:25.636 INFO 9 --- [prometheus-minute-schedule-1,55b98387368fdde6,de1c09a3a54a5f35] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:25.639 INFO 9 --- [prometheus-minute-schedule-1,55b98387368fdde6,de1c09a3a54a5f35] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:26.774 WARN 9 --- [ocp-async-5,2f72a72d56bbf634,5a0a8fec7c2195f6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:26.774 INFO 9 --- [ocp-async-8,84867bbf10dbb7aa,8a00e73a42f497b8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:27.442 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:27.442 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:27.928 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.931 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitra 2025-09-16 13:49:27.935 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.939 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.942 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.946 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.949 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.962 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.962 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION is disabled or lacking of config 2025-09-16 13:49:27.975 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:27.988 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 15 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:28.058 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:28.062 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:28.065 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:28.069 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:28.072 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:28.076 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:43:27.678, end=2025-09-16T13:48:27.926} 2025-09-16 13:49:28.076 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 5 dubious sqls 2025-09-16 13:49:28.636 INFO 9 --- [prometheus-minute-schedule-1,81547b18e66b7fa8,a0387d28307d6140] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:28.639 INFO 9 --- [prometheus-minute-schedule-1,81547b18e66b7fa8,a0387d28307d6140] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:28.774 WARN 9 --- [ocp-async-2,d20dc3b3115283b0,a6fe85157a1a2f8b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:28.774 INFO 9 --- [ocp-async-10,ece885f4668ecc9b,36fff1391512c09e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:28.855 INFO 9 --- [ocp-schedules-18,e8846fd43c124d17,9a9044a6c0bbc69d] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:49:28.857 INFO 9 --- [ocp-schedules-18,e8846fd43c124d17,9a9044a6c0bbc69d] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:49:29.938 INFO 9 --- [ocp-schedules-17,e4acfdfe4baccc29,54e2c1612286bb9e] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:49:29.941 INFO 9 --- [ocp-schedules-9,b1e9e06f845f3a25,b0006aac15922adf] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:49:29.941 INFO 9 --- [ocp-schedules-12,f32f99da97fa0762,7447cde0f25f655a] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:49:29.942 INFO 9 --- [ocp-schedules-19,b983b31fc1576309,88b2f6d53327ddf7] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:49:29.943 INFO 9 --- [ocp-schedules-9,b1e9e06f845f3a25,b0006aac15922adf] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:29.943 INFO 9 --- [ocp-schedules-19,b983b31fc1576309,88b2f6d53327ddf7] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:29.944 INFO 9 --- [ocp-schedules-12,f32f99da97fa0762,7447cde0f25f655a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:29.944 INFO 9 --- [ocp-schedules-19,b983b31fc1576309,88b2f6d53327ddf7] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:49:29.944 INFO 9 --- [ocp-schedules-30,270c2c13c5f92c38,fa48953a68e275dd] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:49:29.945 INFO 9 --- [ocp-schedules-20,1ce81858f382049a,4a8891aefc06343c] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:49:29.945 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-agent-status1,1ce81858f382049a,435f360717f3f645] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-agent-status2,1ce81858f382049a,69f43f935df9133c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-agent-status3,1ce81858f382049a,0dccba0a99a9f188] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-agent-status4,1ce81858f382049a,ffcc5a47cbee1f37] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-agent-status5,1ce81858f382049a,5f33290a57218fa1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:49:29.945 INFO 9 --- [host-check-agent-status6,1ce81858f382049a,1daefd9b36af1711] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:49:29.946 INFO 9 --- [ocp-schedules-28,b1bd6faacb41d3e4,e0dcc40fb0a0fe92] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:49:29.946 INFO 9 --- [host-check-clockdiff1,b1bd6faacb41d3e4,9860c719a0850e4d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:49:29.946 INFO 9 --- [host-check-clockdiff2,b1bd6faacb41d3e4,35eebea8f256f06a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:49:29.946 INFO 9 --- [host-check-clockdiff3,b1bd6faacb41d3e4,8b629ed9957b0f00] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:49:29.946 INFO 9 --- [host-check-clockdiff4,b1bd6faacb41d3e4,37b81acf9f342b9c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:49:29.946 INFO 9 --- [host-check-clockdiff5,b1bd6faacb41d3e4,0283a6fc3c293199] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:49:29.946 INFO 9 --- [host-check-clockdiff6,b1bd6faacb41d3e4,1ea968027582b52e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:49:29.947 INFO 9 --- [ocp-schedules-18,05fd0024665d40eb,122486f1e4e670c6] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:49:29.953 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:49:29.953 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:49:29.953 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:49:29.953 INFO 9 --- [host-check-agent-status1,1ce81858f382049a,435f360717f3f645] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:49:29.954 INFO 9 --- [host-check-clockdiff4,b1bd6faacb41d3e4,37b81acf9f342b9c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001769 -1 -1 , error= 2025-09-16 13:49:29.954 INFO 9 --- [host-check-clockdiff2,b1bd6faacb41d3e4,35eebea8f256f06a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001769 -2 -2 , error= 2025-09-16 13:49:29.955 INFO 9 --- [host-check-clockdiff3,b1bd6faacb41d3e4,8b629ed9957b0f00] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001769 -1 -1 , error= 2025-09-16 13:49:29.955 INFO 9 --- [host-check-clockdiff1,b1bd6faacb41d3e4,9860c719a0850e4d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001769 -1 -1 , error= 2025-09-16 13:49:29.955 INFO 9 --- [host-check-clockdiff6,b1bd6faacb41d3e4,1ea968027582b52e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001769 -1 -1 , error= 2025-09-16 13:49:29.956 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:29.956 INFO 9 --- [host-check-agent-status3,1ce81858f382049a,0dccba0a99a9f188] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:49:29.956 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:49:29.956 INFO 9 --- [host-check-agent-status2,1ce81858f382049a,69f43f935df9133c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:49:29.958 INFO 9 --- [host-check-agent-status4,1ce81858f382049a,ffcc5a47cbee1f37] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:49:29.958 INFO 9 --- [host-check-agent-status5,1ce81858f382049a,5f33290a57218fa1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:49:29.958 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:49:29.958 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:49:29.958 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:49:29.959 INFO 9 --- [host-check-agent-status6,1ce81858f382049a,1daefd9b36af1711] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:29.959 INFO 9 --- [host-check-clockdiff5,b1bd6faacb41d3e4,0283a6fc3c293199] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001769 -1 -1 , error= 2025-09-16 13:49:29.959 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:49:29.959 INFO 9 --- [host-check-agent-status2,1ce81858f382049a,69f43f935df9133c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:49:29.959 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:49:29.960 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:29.960 INFO 9 --- [host-check-agent-status3,1ce81858f382049a,0dccba0a99a9f188] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:49:29.960 INFO 9 --- [host-check-agent-status1,1ce81858f382049a,435f360717f3f645] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:49:29.960 INFO 9 --- [host-check-agent-status5,1ce81858f382049a,5f33290a57218fa1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:49:29.960 INFO 9 --- [host-check-agent-status4,1ce81858f382049a,ffcc5a47cbee1f37] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:49:29.960 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:49:29.960 INFO 9 --- [host-check-agent-status6,1ce81858f382049a,1daefd9b36af1711] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:29.962 INFO 9 --- [ocp-schedules-22,cd8c31bbd492d844,e2861d96be188935] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:49:29.963 INFO 9 --- [ocp-schedules-10,d048bf90f7e2ff0e,3b6d06989b1f5c6b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:49:29.968 INFO 9 --- [ocp-schedules-22,cd8c31bbd492d844,e2861d96be188935] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:49:29.969 INFO 9 --- [ocp-schedules-10,d048bf90f7e2ff0e,3b6d06989b1f5c6b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:49:29.974 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:49:29.974 INFO 9 --- [host-check-agent-status5,1ce81858f382049a,5f33290a57218fa1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:49:29.974 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:49:29.974 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:49:29.974 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:49:29.974 INFO 9 --- [host-check-agent-status3,1ce81858f382049a,0dccba0a99a9f188] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:49:29.974 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:49:29.974 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:49:29.975 INFO 9 --- [host-check-agent-status6,1ce81858f382049a,1daefd9b36af1711] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:49:29.975 INFO 9 --- [host-check-agent-status1,1ce81858f382049a,435f360717f3f645] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:49:29.975 INFO 9 --- [host-check-agent-status4,1ce81858f382049a,ffcc5a47cbee1f37] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:49:29.976 INFO 9 --- [host-check-agent-status2,1ce81858f382049a,69f43f935df9133c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:49:29.974840226+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:49:29.975247234+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:49:29.975369967+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:49:29.974899250+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:49:29.975130947+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:49:29.975352236+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:49:29.976+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:49:29.976+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:49:29.976+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:49:29.976+08:00 2025-09-16 13:49:29.976 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:49:29.976+08:00 2025-09-16 13:49:29.977 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:49:29.976+08:00 2025-09-16 13:49:29.977 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:29.977 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:49:29.978 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:49:29.976+08:00 and status AVAILABLE 2025-09-16 13:49:29.978 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:49:29.976+08:00 and status AVAILABLE 2025-09-16 13:49:29.978 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:49:29.976+08:00 and status AVAILABLE 2025-09-16 13:49:29.978 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:49:29.976+08:00 and status AVAILABLE 2025-09-16 13:49:29.978 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:49:29.976+08:00 and status AVAILABLE 2025-09-16 13:49:29.978 INFO 9 --- [host-check-agent-status5,1ce81858f382049a,5f33290a57218fa1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:49:29.978 INFO 9 --- [host-check-agent-status5,1ce81858f382049a,5f33290a57218fa1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:49:29.978 INFO 9 --- [host-check-agent-status5,1ce81858f382049a,5f33290a57218fa1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:49:29.978 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:49:29.976+08:00 and status AVAILABLE 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status3,1ce81858f382049a,0dccba0a99a9f188] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status3,1ce81858f382049a,0dccba0a99a9f188] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status3,1ce81858f382049a,0dccba0a99a9f188] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status6,1ce81858f382049a,1daefd9b36af1711] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status6,1ce81858f382049a,1daefd9b36af1711] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status6,1ce81858f382049a,1daefd9b36af1711] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status1,1ce81858f382049a,435f360717f3f645] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status1,1ce81858f382049a,435f360717f3f645] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:49:29.979 INFO 9 --- [host-check-agent-status1,1ce81858f382049a,435f360717f3f645] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:49:29.980 INFO 9 --- [host-check-agent-status2,1ce81858f382049a,69f43f935df9133c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:49:29.980 INFO 9 --- [host-check-agent-status2,1ce81858f382049a,69f43f935df9133c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:49:29.980 INFO 9 --- [host-check-agent-status2,1ce81858f382049a,69f43f935df9133c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:49:29.981 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:49:29.982 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:49:29.982 INFO 9 --- [ocp-schedules-12,f32f99da97fa0762,7447cde0f25f655a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:49:29.983 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:49:29.983 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:49:29.983 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:49:29.983 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:49:29.983 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:49:29.985 INFO 9 --- [host-check-agent-status4,1ce81858f382049a,ffcc5a47cbee1f37] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:49:29.985 INFO 9 --- [host-check-agent-status4,1ce81858f382049a,ffcc5a47cbee1f37] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:49:29.985 INFO 9 --- [host-check-agent-status4,1ce81858f382049a,ffcc5a47cbee1f37] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:49:29.987 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:49:29.987 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:49:29.988 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:49:29.988 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:29.988 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:49:29.989 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:49:29.989 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:49:29.989 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:49:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:29.989 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:29.989 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:49:29.989 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:49:29.989 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:49:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:49:30.003 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:49:30.003435+08:00, lastProcessTime=2025-09-16T13:49:20.002754+08:00 2025-09-16 13:49:30.005 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:30.005 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:30.005 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:30.005 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:30.005 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:49:30.031 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:49:30.032 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:49:30.033 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:49:30.033 INFO 9 --- [ocp-schedules-14,f47fa06ad0423ce1,2e1ad999c44fa1ec] c.o.o.a.service.OcpAlarmInspectService : delete inactive alarm event count 0 2025-09-16 13:49:30.033 INFO 9 --- [ocp-schedules-14,f47fa06ad0423ce1,2e1ad999c44fa1ec] c.o.o.a.service.OcpAlarmInspectService : deleteInactiveAlarmEvents count 0 2025-09-16 13:49:30.033 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:49:30.033 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:49:30.033 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:49:30.033 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:30.035 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:30.036 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:49:30.038 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:49:30.039 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:49:30.040 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:49:30.040 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:49:30.040 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:49:30.040 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:49:30.050 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:30.051 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:30.051 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:30.053 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:30.053 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:30.053 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:49:30.070 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:49:30.076 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:30.078 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:49:30.078 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:49:30.078 INFO 9 --- [ocp-schedules-24,4a6f05243ddd6ffc,2603404e4967590f] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:49:30.078 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:49:30.079 INFO 9 --- [ocp-schedules-24,4a6f05243ddd6ffc,2603404e4967590f] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:49:30.079 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:49:30.079 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:30.080 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:49:30.080 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:49:30.083 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:49:30.085 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:49:30.085 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:49:30.086 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:49:30.086 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:49:30.087 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:49:30.089 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:49:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:30.098 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:30.099 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:30.099 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:30.099 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:30.099 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:30.101 INFO 9 --- [prometheus-second-schedule-1,d2a4d6fd7bdf2c71,c395ef0c53dc18c9] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:49:30.101 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:49:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:30.125 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:49:30.126 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:49:30.127 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:49:30.127 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:49:30.127 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:49:30.129 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.129 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:30.129 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:49:30.130 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:49:30.003435+08:00 2025-09-16 13:49:30.132 INFO 9 --- [host-check-host-status1,270c2c13c5f92c38,d155ae8294610e94] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:49:30.133 INFO 9 --- [host-check-host-status2,270c2c13c5f92c38,19e25f47c1c6e3cf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:49:30.134 INFO 9 --- [host-check-host-status3,270c2c13c5f92c38,96f2035d783ee6c3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:49:30.134 INFO 9 --- [host-check-host-status6,270c2c13c5f92c38,6377a12aeaa18a5a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:49:30.135 INFO 9 --- [host-check-host-status4,270c2c13c5f92c38,4edbf4aab1c0cd73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:49:30.135 INFO 9 --- [host-check-host-status5,270c2c13c5f92c38,760d09d7b4c41d6b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:49:30.146 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.146 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:30.159 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.159 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:30.175 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.175 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:30.180 INFO 9 --- [ocp-async-8,a471b9fb17c1cb1d,be635e8e4de8b992] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:49:30.189 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.189 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:30.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:49:30.219 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.219 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:49:30.234 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:49:30.248 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:30.249 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:30.250 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:49:30.255 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:49:30.257 INFO 9 --- [ocp-schedules-8,740d55bc0f4a0fda,94c23f45d36798c6] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:49:30.258 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:49:30.262 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:30.262 WARN 9 --- [scanner-1367627-1,740d55bc0f4a0fda,912bb7c6c6fc0974] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:49:30.263 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:30.265 INFO 9 --- [ocp-schedules-17,bf9002543795055a,e56915bf4561ba90] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:49:30.266 INFO 9 --- [ocp-schedules-17,bf9002543795055a,e56915bf4561ba90] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:30.267 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:49:30.267 INFO 9 --- [ocp-schedules-17,bf9002543795055a,e56915bf4561ba90] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:49:30.280 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:49:30.345 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:49:30.359 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:30.360 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:30.361 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:49:30.375 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:49:30.375 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:49:30.376 INFO 9 --- [ocp-schedules-9,b1e9e06f845f3a25,b0006aac15922adf] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:49:30.392 INFO 9 --- [ocp-schedules-15,dcc9e8b8d438e77c,3a7f2d31889bf20d] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:49:30.443 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:30.443 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:30.568 INFO 9 --- [ocp-schedules-28,95243feed553890a,35b95dc8afd366aa] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:49:30.570 INFO 9 --- [ocp-schedules-28,95243feed553890a,35b95dc8afd366aa] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:49:30.570 INFO 9 --- [ocp-schedules-28,95243feed553890a,35b95dc8afd366aa] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:49:30.774 INFO 9 --- [ocp-async-1,1c8d2939d9904fec,e2ea616596b20016] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:30.774 WARN 9 --- [ocp-async-5,694170279ed0075c,ea7e8e258c3d4195] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:30.825 INFO 9 --- [ocp-schedules-2,f4136c7007ff8e5c,35cdbd4a37a4476b] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:49:30.960 INFO 9 --- [ocp-schedules-24,d739f00fd07a0e85,e2c6272c1806b175] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:49:30.960 INFO 9 --- [ocp-schedules-24,d739f00fd07a0e85,e2c6272c1806b175] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:49:31.432 INFO 9 --- [ocp-schedules-11,03ca1da95e507d34,b151e016bfd1519a] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:49:31.432 INFO 9 --- [ocp-schedules-11,03ca1da95e507d34,b151e016bfd1519a] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001771 2025-09-16 13:49:31.433 INFO 9 --- [ocp-schedules-11,03ca1da95e507d34,b151e016bfd1519a] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:49:31.610 INFO 9 --- [ocp-schedules-17,57ff44555d7b5f06,6c6f2f1ecc90f194] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:49:31.636 INFO 9 --- [prometheus-minute-schedule-1,3accc2bc3cee84b0,91077905644e755c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:31.639 INFO 9 --- [prometheus-minute-schedule-1,3accc2bc3cee84b0,91077905644e755c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:31.663 INFO 9 --- [ocp-schedules-29,cd42425ce3939488,a710dbabb6ba878e] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:49:31.677 INFO 9 --- [ocp-schedules-19,aa31bfb132f3c36b,dd7d234f150fe845] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:49:31.677 INFO 9 --- [ocp-schedules-19,aa31bfb132f3c36b,dd7d234f150fe845] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:49:31.678 INFO 9 --- [ocp-schedules-19,aa31bfb132f3c36b,dd7d234f150fe845] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:49:31.678 INFO 9 --- [ocp-schedules-19,aa31bfb132f3c36b,dd7d234f150fe845] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:49:31.679 INFO 9 --- [ocp-schedules-19,aa31bfb132f3c36b,dd7d234f150fe845] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:49:31.679 INFO 9 --- [ocp-schedules-19,aa31bfb132f3c36b,dd7d234f150fe845] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:49:32.774 WARN 9 --- [ocp-async-8,79ef7413c7c0867d,c3cef3cedaaa4fbf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:32.774 INFO 9 --- [ocp-async-2,4046fd9343085e17,c1e4cdff41bacb2d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:33.348 INFO 9 --- [ocp-schedules-15,424e5a34431fe796,5a38bab21eb4dc13] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:49:33.443 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:33.444 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:33.479 INFO 9 --- [ocp-schedules-12,28af23f707ccf876,5d771e089595402c] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:49:33.479+08:00, clusters=[1] 2025-09-16 13:49:33.480 INFO 9 --- [ocp-schedules-12,28af23f707ccf876,5d771e089595402c] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:49:34.035 INFO 9 --- [ocp-schedules-24,7c7c0d87b482af1a,ab82d933ce6bda25] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:49:34.035 INFO 9 --- [ocp-schedules-24,7c7c0d87b482af1a,ab82d933ce6bda25] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:49:34.036 INFO 9 --- [ocp-schedules-24,7c7c0d87b482af1a,ab82d933ce6bda25] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:49:34.051 INFO 9 --- [ocp-schedules-24,7c7c0d87b482af1a,ab82d933ce6bda25] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:49:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:49:34.544 INFO 9 --- [ocp-schedules-2,95d09f0dbf1b93de,62a8ce177e2eb717] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:49:34.549 INFO 9 --- [ocp-schedules-2,95d09f0dbf1b93de,62a8ce177e2eb717] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:49:34.549 INFO 9 --- [ocp-schedules-2,95d09f0dbf1b93de,62a8ce177e2eb717] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:49:34.636 INFO 9 --- [prometheus-minute-schedule-1,7fa4776aeab94425,7fd98f6729f9eff4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:34.639 INFO 9 --- [prometheus-minute-schedule-1,7fa4776aeab94425,7fd98f6729f9eff4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:34.669 INFO 9 --- [ocp-schedules-11,bbd6ec7acb8a95d3,5b8e7ca1a8ed3a25] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:49:34.774 WARN 9 --- [ocp-async-10,5c44c195e681d73d,451e07d6f329f2c8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:34.774 INFO 9 --- [ocp-async-6,c52347ba1fba8346,52b9013fd279a91d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:35.514 INFO 9 --- [ocp-schedules-13,0cac458a87e22614,d4e046bba4ec4662] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:49:35.514+08:00, clusters=[1] 2025-09-16 13:49:35.518 INFO 9 --- [ocp-schedules-13,0cac458a87e22614,d4e046bba4ec4662] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:49:36.444 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:36.445 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:36.774 WARN 9 --- [ocp-async-9,10b14bd1811dab51,27d2e3f2646f058a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:36.774 INFO 9 --- [ocp-async-5,0406c4bb86444a26,aa02b3aa8fa44074] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:37.631 INFO 9 --- [ocp-schedules-4,aa34bac85cdb5fb8,61423014bbc005f3] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:49:37.632 INFO 9 --- [ocp-schedules-4,aa34bac85cdb5fb8,61423014bbc005f3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:37.636 INFO 9 --- [prometheus-minute-schedule-1,af76996225c93f52,5bceeab84c7ee448] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:37.639 INFO 9 --- [prometheus-minute-schedule-1,af76996225c93f52,5bceeab84c7ee448] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:37.652 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:37.652 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:49:37.665 INFO 9 --- [ocp-schedules-4,aa34bac85cdb5fb8,61423014bbc005f3] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:49:38.774 WARN 9 --- [ocp-async-1,04e1a44a84748959,ebd21d382ce449c5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:38.774 INFO 9 --- [ocp-async-3,b902dda4e7e5cf45,8d3d92c4f1dbf9f2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:38.861 INFO 9 --- [ocp-schedules-29,044d5e20cbf9f43b,1d7e9a5a219f7d98] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:49:38.864 INFO 9 --- [ocp-schedules-29,044d5e20cbf9f43b,1d7e9a5a219f7d98] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:49:39.445 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:39.446 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:39.646 INFO 9 --- [ocp-schedules-10,d8cab404a1c6c4bd,4e4e509d6fbc73ba] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:49:39.646 INFO 9 --- [ocp-schedules-10,d8cab404a1c6c4bd,4e4e509d6fbc73ba] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:49:39.658 INFO 9 --- [ocp-schedules-9,45b9d8dc9af05608,10e4956e1cb4beef] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:49:39.658 INFO 9 --- [ocp-schedules-9,45b9d8dc9af05608,10e4956e1cb4beef] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:49:39.658 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:49:39.658 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:49:39.658 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:49:39.658 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:49:39.661 INFO 9 --- [ocp-schedules-9,45b9d8dc9af05608,10e4956e1cb4beef] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:49:39.661 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:49:39.662 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:49:39.662 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:49:39.662 INFO 9 --- [Collect all tenants major compactions3,d8cab404a1c6c4bd,d6f69afe83d1116d] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:49:39.662 INFO 9 --- [ocp-schedules-9,45b9d8dc9af05608,10e4956e1cb4beef] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:49:39.662 INFO 9 --- [Collect all tenants major compactions2,d8cab404a1c6c4bd,6cd957d7af6ccc3d] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:49:39.662 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:39.662 INFO 9 --- [Collect all tenants major compactions1,d8cab404a1c6c4bd,e0c8a98b8f4e7711] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:49:39.662 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:49:39.662 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:49:39.663 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:49:39.663 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:39.676 INFO 9 --- [ocp-schedules-9,45b9d8dc9af05608,10e4956e1cb4beef] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:49:39.676 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:49:39.676 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:49:39.676 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:49:39.677 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:49:39.678 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:49:39.680 INFO 9 --- [Collect all tenants major compactions3,d8cab404a1c6c4bd,d6f69afe83d1116d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:39.680 INFO 9 --- [Collect all tenants major compactions2,d8cab404a1c6c4bd,6cd957d7af6ccc3d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:39.680 INFO 9 --- [Collect all tenants major compactions1,d8cab404a1c6c4bd,e0c8a98b8f4e7711] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:39.681 INFO 9 --- [Collect all tenants major compactions1,d8cab404a1c6c4bd,e0c8a98b8f4e7711] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:49:39.681 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:49:39.681 INFO 9 --- [Collect all tenants major compactions3,d8cab404a1c6c4bd,d6f69afe83d1116d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:49:39.681 INFO 9 --- [Collect all tenants major compactions2,d8cab404a1c6c4bd,6cd957d7af6ccc3d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:49:39.682 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:49:39.684 INFO 9 --- [Collect all tenants major compactions1,d8cab404a1c6c4bd,e0c8a98b8f4e7711] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:49:39.685 INFO 9 --- [Collect all tenants major compactions3,d8cab404a1c6c4bd,d6f69afe83d1116d] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:49:39.686 INFO 9 --- [Collect all tenants major compactions2,d8cab404a1c6c4bd,6cd957d7af6ccc3d] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:49:39.686 INFO 9 --- [ocp-schedules-10,d8cab404a1c6c4bd,4e4e509d6fbc73ba] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:49:39.695 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:49:39.696 INFO 9 --- [ocp-schedules-9,45b9d8dc9af05608,10e4956e1cb4beef] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:49:40.002 INFO 9 --- [ocp-schedules-19,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:49:40.002 INFO 9 --- [ocp-schedules-3,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:49:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:49:40.003672+08:00, lastProcessTime=2025-09-16T13:49:30.003435+08:00 2025-09-16 13:49:40.119 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:49:40.003672+08:00 2025-09-16 13:49:40.180 INFO 9 --- [ocp-async-9,09ac99dc90632ca2,63992b3e077a03a9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:49:40.285 INFO 9 --- [ocp-schedules-7,c988e0ec9a87830a,64de6dd5aa5e66ad] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:49:40.290 WARN 9 --- [scanner-1367752-1,c988e0ec9a87830a,2a787f24c47cc3fb] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:49:40.301 INFO 9 --- [alarm-detect-15,c988e0ec9a87830a,b3672d0e0b5bfe3f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:49:40.303 INFO 9 --- [alarm-detect-2,c988e0ec9a87830a,e8a6f1b91f95442b] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:49:40.303 INFO 9 --- [alarm-detect-4,c988e0ec9a87830a,c6698ae66be39841] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:49:40.316 INFO 9 --- [alarm-detect-9,c988e0ec9a87830a,a3bbba50102b9bcc] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:49:40.636 INFO 9 --- [prometheus-minute-schedule-1,9537831e08f167fb,b6d019c5c01a9cc3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:40.639 INFO 9 --- [prometheus-minute-schedule-1,9537831e08f167fb,b6d019c5c01a9cc3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:40.716 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:45:40.568, end=2025-09-16T13:47:40.715} 2025-09-16 13:49:40.719 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbit 2025-09-16 13:49:40.720 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:49:40.726 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 3 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:45:40.568, end=2025-09-16T13:47:40.715},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:49:40.735 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:49:40.735 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:49:40.745 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:49:40.746 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:45:40.568, end=2025-09-16T13:47:40.715},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:49:40.746 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:49:40.746 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:49:40.751 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:49:40.752 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:45:40.568, end=2025-09-16T13:47:40.715},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:49:40.752 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:49:40.752 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:49:40.756 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:49:40.775 WARN 9 --- [ocp-async-7,a8efc5f516bb8412,7ec70e2fba99ea91] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:40.775 INFO 9 --- [ocp-async-6,30e701785f440d1b,c6eeb663b00bbf60] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:40.926 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,8cace86ab52f01d0,9bc92f18cc4d2b2e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=8cace86ab52f01d0, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:49:40.927 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,8cace86ab52f01d0,9bc92f18cc4d2b2e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=8cace86ab52f01d0, duration=1 ms] 2025-09-16 13:49:42.063 INFO 9 --- [ocp-schedules-13,47d5fa8273eee129,857e7245e9de1d4a] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:49:42.063 INFO 9 --- [ocp-schedules-13,47d5fa8273eee129,857e7245e9de1d4a] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:49:42.102 INFO 9 --- [ocp-schedules-13,47d5fa8273eee129,857e7245e9de1d4a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:42.103 INFO 9 --- [ocp-schedules-13,47d5fa8273eee129,857e7245e9de1d4a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:49:42.446 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:42.446 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:42.775 INFO 9 --- [ocp-async-9,dbd1e43950082c0c,69b0d41101468f13] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:42.775 WARN 9 --- [ocp-async-5,e127e6d2b70efa20,a4a7e982581dfa17] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:42.910 INFO 9 --- [ocp-schedules-18,a22ed79fe0fa0fe8,98c5e6677a787d29] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:49:42.911 INFO 9 --- [ocp-schedules-18,a22ed79fe0fa0fe8,98c5e6677a787d29] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:42.957 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:49:42.958 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:42.960 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:49:42.986 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:42.986 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:49:43.009 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.010 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:49:43.033 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.034 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:49:43.038 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.039 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:49:43.063 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.063 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:49:43.087 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.087 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:49:43.092 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.093 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:49:43.116 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.117 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:49:43.141 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.141 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:49:43.159 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.160 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:49:43.161 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.162 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:49:43.162 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.163 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:49:43.164 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.165 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:49:43.165 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.166 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:49:43.167 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.167 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:49:43.183 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.184 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:49:43.185 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.186 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:49:43.186 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.187 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:49:43.201 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:49:43.203 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:49:43.229 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:49:43.231 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:43.231 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:49:43.260 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:49:43.260 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:49:43.260 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:49:43.260 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:49:43.260 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:49:43.260 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:49:43.262 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:49:43.262 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:49:43.262 INFO 9 --- [ocp-schedules-18,a22ed79fe0fa0fe8,98c5e6677a787d29] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:49:43.636 INFO 9 --- [prometheus-minute-schedule-1,bd641e6cc275a772,affc87cee516e03a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:43.640 INFO 9 --- [prometheus-minute-schedule-1,bd641e6cc275a772,affc87cee516e03a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 13:49:43,902 |-INFO in ReconfigureOnChangeTask(born:1758001603902) - Empty watch file list. Disabling 2025-09-16 13:49:44.256 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 13:49:44.256 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 13:49:44.259 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:49:44.259 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:49:44.259 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:49:44.259 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:49:44.261 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:49:44.261 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:49:44.261 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:49:44.261 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:49:44.279 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:49:44.284 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:49:44.284 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:49:44.284 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:49:44.284 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:49:44.284 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:49:44.288 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:49:44.565 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 13:49:44.672 INFO 9 --- [ocp-schedules-15,ec044d039edabf7a,30abdb53820eee35] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:49:44.775 INFO 9 --- [ocp-async-8,b16a8aa0a514e4e0,159a5b7ce907d880] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:44.775 WARN 9 --- [ocp-async-3,a875afef2a59645c,caa9f3767c7085dc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:44.840 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.578315325S 2025-09-16 13:49:44.840 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:49:44.892 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 13:49:44.892 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 13:49:44.922 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 13:49:44,934 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:49:44,935 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:49:44,935 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:49:44,936 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:49:44,936 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:49:44,937 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:49:44,934 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:49:44,935 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:49:44,935 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:49:44,936 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:49:44,936 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:49:44,937 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:49:44,937 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@2e86a656 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 13:49:44,939 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 13:49:44,939 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 13:49:44,941 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 13:49:44,941 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@2e86a656 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 13:49:44,942 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 13:49:44,942 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 13:49:44,942 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 13:49:44,942 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 13:49:44,942 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:49:44,942 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 13:49:44,943 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:49:44,943 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:49:44,943 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:49:44,943 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 13:49:44,943 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 13:49:44,943 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 13:49:44,943 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 13:49:44,943 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:49:44,943 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 13:49:44,943 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1088959893 - setting totalSizeCap to 10 GB 13:49:44,943 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1088959893 - Archive files will be limited to [100 MB] each. 13:49:44,943 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1088959893 - Will use gz compression 13:49:44,944 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1088959893 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 13:49:44,944 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5b479fc8 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 13:49:44,944 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5b479fc8 - Roll-over at midnight. 13:49:44,944 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@5b479fc8 - Setting initial period to Tue Sep 16 13:49:44 CST 2025 13:49:44,944 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1088959893 - Cleaning on start up 13:49:44,944 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 13:49:44,944 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 13:49:44,944 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 13:49:44,944 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 13:49:44,944 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:49:44,944 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 13:49:44,944 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 13:49:44,944 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 13:49:44,945 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 13:49:44,945 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:49:44,945 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 13:49:44,945 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1289794863 - setting totalSizeCap to 10 GB 13:49:44,945 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1289794863 - Archive files will be limited to [100 MB] each. 13:49:44,945 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1289794863 - Will use gz compression 13:49:44,945 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1289794863 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 13:49:44,945 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4da565bb - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 13:49:44,945 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4da565bb - Roll-over at midnight. 13:49:44,945 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@4da565bb - Setting initial period to Tue Sep 16 13:49:40 CST 2025 13:49:44,945 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 13:49:44,945 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 13:49:44,945 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:49:44,945 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 13:49:44,945 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 13:49:44,945 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 13:49:44,945 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 13:49:44,945 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 13:49:44,945 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 13:49:44,945 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 13:49:44,945 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 13:49:44,945 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 13:49:44,946 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating INFO level on Logger[ROOT] onto the JUL framework 13:49:44,946 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 13:49:44,946 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 13:49:44,946 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 13:49:44,946 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:49:44,946 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@2a7b0a18 - Registering current configuration as safe fallback point 13:49:44,947 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 13:49:44,949 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating INFO level on Logger[web] onto the JUL framework 13:49:44,950 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 13:49:44,950 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6b283fc4 - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 13:49:44.951 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:49:44.951 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:49:44.951 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:49:44.951 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:49:44.951 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:49:44.951 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 13:49:44.957 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:49:45.044 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] o.s.boot.SpringApplication : Started application in 0.785 seconds (JVM running for 12760.089) 2025-09-16 13:49:45.045 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.78602665S 2025-09-16 13:49:45.293 INFO 9 --- [ocp-schedules-17,887bd14e451b59f2,440f204ca8f655ef] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 13:49:45.446 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:45.447 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:46.636 INFO 9 --- [prometheus-minute-schedule-1,85067a644e800d99,f570c37ecde539a3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:46.639 INFO 9 --- [prometheus-minute-schedule-1,85067a644e800d99,f570c37ecde539a3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:46.775 INFO 9 --- [ocp-async-10,54f29598cdb23cac,8880103bd978479e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:46.775 WARN 9 --- [ocp-async-7,7c78105b3ee66f06,fdadb1ad195fcf9f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:48.447 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:48.448 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:48.775 INFO 9 --- [ocp-async-6,df17e2dcc193b20e,f5ab8fc79d27db97] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:48.775 WARN 9 --- [ocp-async-5,1b1d3f7c5ab71eec,a7c4d9ae0d4ea391] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:48.867 INFO 9 --- [ocp-schedules-29,98b8d7d490dcb341,a30c6fff2f12572b] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:49:48.870 INFO 9 --- [ocp-schedules-29,98b8d7d490dcb341,a30c6fff2f12572b] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:49:49.636 INFO 9 --- [prometheus-minute-schedule-1,4f2bf9e9f493d4e1,685877d798e0edea] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:49.639 INFO 9 --- [prometheus-minute-schedule-1,4f2bf9e9f493d4e1,685877d798e0edea] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:49:50.004767+08:00, lastProcessTime=2025-09-16T13:49:40.003672+08:00 2025-09-16 13:49:50.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:49:50.004767+08:00 2025-09-16 13:49:50.180 INFO 9 --- [ocp-async-7,e13becf303c1a31e,e4b680751971ef16] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:49:50.319 INFO 9 --- [ocp-schedules-12,3d26d51fad935835,89811a7013d06ad8] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:49:50.324 WARN 9 --- [scanner-1367913-1,3d26d51fad935835,a9370fc8fc83621a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:49:50.775 INFO 9 --- [ocp-async-3,c301bc469c643e6c,63e1a6ed8b8a7d66] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:50.775 WARN 9 --- [ocp-async-2,1a01b1661306fd99,11952567a81cc8d6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:51.448 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:51.448 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:52.636 INFO 9 --- [prometheus-minute-schedule-1,e0176fc2d6a6496b,66ebf61b7ff9be95] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:52.639 INFO 9 --- [prometheus-minute-schedule-1,e0176fc2d6a6496b,66ebf61b7ff9be95] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:52.775 WARN 9 --- [ocp-async-7,c501cd706547c72a,b0cba60bbc0163be] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:52.775 INFO 9 --- [ocp-async-4,b6adb8816be9a0e8,1d8e3477568ee1c3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:54.448 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:54.449 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:54.551 INFO 9 --- [ocp-schedules-17,21dd16ee9296cbd0,5a4804149780ac8f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:49:54.555 INFO 9 --- [ocp-schedules-17,21dd16ee9296cbd0,5a4804149780ac8f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:49:54.555 INFO 9 --- [ocp-schedules-17,21dd16ee9296cbd0,5a4804149780ac8f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:49:54.676 INFO 9 --- [ocp-schedules-11,b903ec8e4fcc5190,a7bc364c415aeb97] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:49:54.775 WARN 9 --- [ocp-async-5,6a99950dfca8af97,4409741825ea25fd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:54.775 INFO 9 --- [ocp-async-1,13f38017d7de72ca,302be6c7e3eea9af] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:55.636 INFO 9 --- [prometheus-minute-schedule-1,91fd81efc58b6d87,a33f3310a6ce7704] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:55.639 INFO 9 --- [prometheus-minute-schedule-1,91fd81efc58b6d87,a33f3310a6ce7704] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:56.776 WARN 9 --- [ocp-async-9,fa8f4beca29baac8,acfd429cbfcd7377] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:56.776 INFO 9 --- [ocp-async-2,42a53d50649b2251,7c0547e55f3cf3f3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:57.449 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:49:57.449 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:49:58.636 INFO 9 --- [prometheus-minute-schedule-1,1404f828122b0f28,965d790ec73a4fc0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001800, interval=60 2025-09-16 13:49:58.639 INFO 9 --- [prometheus-minute-schedule-1,1404f828122b0f28,965d790ec73a4fc0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:49:58.776 WARN 9 --- [ocp-async-3,15e48e6de837a2e7,99b0c5c3193d36ea] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:49:58.776 INFO 9 --- [ocp-async-7,f1f44463a8bccbe4,fe2bc601eaf99df5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:49:58.874 INFO 9 --- [ocp-schedules-10,0040a7548ee31cb7,aaf9e2a2fce25f2f] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:49:58.876 INFO 9 --- [ocp-schedules-10,0040a7548ee31cb7,aaf9e2a2fce25f2f] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:49:59.938 INFO 9 --- [ocp-schedules-13,dee79fa4d24d5c6f,c6887721c1d039cc] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:49:59.941 INFO 9 --- [ocp-schedules-8,15b9dfbcede59ca7,a0d85c6b93a68a89] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:49:59.941 INFO 9 --- [ocp-schedules-27,8974ff7be40bbb8b,b0ecb2b25b8bf9d1] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:49:59.942 INFO 9 --- [ocp-schedules-29,27ed37d9b7889fee,521f792fafc0e993] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:49:59.943 INFO 9 --- [ocp-schedules-27,8974ff7be40bbb8b,b0ecb2b25b8bf9d1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:59.943 INFO 9 --- [ocp-schedules-8,15b9dfbcede59ca7,a0d85c6b93a68a89] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:59.943 INFO 9 --- [ocp-schedules-29,27ed37d9b7889fee,521f792fafc0e993] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:49:59.944 INFO 9 --- [ocp-schedules-29,27ed37d9b7889fee,521f792fafc0e993] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:49:59.944 INFO 9 --- [ocp-schedules-4,e608aad22cba366b,486a25f305f14ddc] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:49:59.944 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:49:59.944 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:49:59.944 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:49:59.944 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [ocp-schedules-9,8d38e1e8121fec44,80e88432c59b19b3] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:49:59.945 INFO 9 --- [host-check-agent-status1,8d38e1e8121fec44,d944cc660c69f1a3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:49:59.945 INFO 9 --- [host-check-agent-status2,8d38e1e8121fec44,ac31c12216d1f767] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [host-check-agent-status3,8d38e1e8121fec44,e2a5a6b77b0bacb8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [host-check-agent-status4,8d38e1e8121fec44,f08fc165029e05a4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [host-check-agent-status5,8d38e1e8121fec44,f6be5c31867670c1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [host-check-agent-status6,8d38e1e8121fec44,68a949683c5fb74a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:49:59.945 INFO 9 --- [ocp-schedules-18,a7089fc3117619a4,cb57a98984467bf4] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:49:59.946 INFO 9 --- [host-check-clockdiff1,a7089fc3117619a4,f41bae27e3b86ccb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:49:59.946 INFO 9 --- [host-check-clockdiff2,a7089fc3117619a4,39d6729d089e1257] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:49:59.946 INFO 9 --- [host-check-clockdiff3,a7089fc3117619a4,258b94c7ce96df63] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:49:59.946 INFO 9 --- [host-check-clockdiff4,a7089fc3117619a4,6417be64e04beedd] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:49:59.946 INFO 9 --- [host-check-clockdiff5,a7089fc3117619a4,ec8fb6269c073431] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:49:59.946 INFO 9 --- [host-check-clockdiff6,a7089fc3117619a4,657d3530ebbbb5e6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:49:59.947 INFO 9 --- [ocp-schedules-7,655e44c615a2f9a5,0d1045451cf131b6] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:49:59.951 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:49:59.952 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:49:59.952 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:49:59.953 INFO 9 --- [host-check-agent-status3,8d38e1e8121fec44,e2a5a6b77b0bacb8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:49:59.953 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:49:59.953 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:49:59.953 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:59.953 INFO 9 --- [host-check-agent-status6,8d38e1e8121fec44,68a949683c5fb74a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:59.953 INFO 9 --- [host-check-agent-status1,8d38e1e8121fec44,d944cc660c69f1a3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:49:59.953 INFO 9 --- [host-check-agent-status4,8d38e1e8121fec44,f08fc165029e05a4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:49:59.953 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:49:59.953 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:49:59.954 INFO 9 --- [host-check-agent-status2,8d38e1e8121fec44,ac31c12216d1f767] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:49:59.954 INFO 9 --- [host-check-agent-status5,8d38e1e8121fec44,f6be5c31867670c1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:49:59.954 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:49:59.954 INFO 9 --- [host-check-agent-status6,8d38e1e8121fec44,68a949683c5fb74a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:59.954 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:49:59.954 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:49:59.954 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:59.954 INFO 9 --- [host-check-agent-status4,8d38e1e8121fec44,f08fc165029e05a4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:49:59.955 INFO 9 --- [host-check-agent-status1,8d38e1e8121fec44,d944cc660c69f1a3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:49:59.955 INFO 9 --- [host-check-agent-status3,8d38e1e8121fec44,e2a5a6b77b0bacb8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:49:59.955 INFO 9 --- [host-check-agent-status2,8d38e1e8121fec44,ac31c12216d1f767] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:49:59.955 INFO 9 --- [host-check-agent-status5,8d38e1e8121fec44,f6be5c31867670c1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:49:59.968 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:49:59.969 INFO 9 --- [host-check-agent-status2,8d38e1e8121fec44,ac31c12216d1f767] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:49:59.969 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:49:59.969 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:49:59.969 INFO 9 --- [host-check-agent-status3,8d38e1e8121fec44,e2a5a6b77b0bacb8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:49:59.969 INFO 9 --- [host-check-agent-status1,8d38e1e8121fec44,d944cc660c69f1a3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:49:59.970 INFO 9 --- [host-check-agent-status5,8d38e1e8121fec44,f6be5c31867670c1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:49:59.970 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:49:59.970 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:49:59.970 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:49:59.970 INFO 9 --- [host-check-agent-status6,8d38e1e8121fec44,68a949683c5fb74a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:49:59.970 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:49:59.968812993+08:00 2025-09-16 13:49:59.970 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:49:59.970+08:00 2025-09-16 13:49:59.971 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:49:59.969701378+08:00 2025-09-16 13:49:59.971 INFO 9 --- [host-check-agent-status4,8d38e1e8121fec44,f08fc165029e05a4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:49:59.971 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:49:59.970397877+08:00 2025-09-16 13:49:59.971 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:49:59.970470634+08:00 2025-09-16 13:49:59.971 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:49:59.971+08:00 2025-09-16 13:49:59.971 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:59.971 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:49:59.970443559+08:00 2025-09-16 13:49:59.971 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:49:59.971+08:00 2025-09-16 13:49:59.971 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:49:59.971+08:00 2025-09-16 13:49:59.972 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:49:59.970823450+08:00 2025-09-16 13:49:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:49:59.972 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:49:59.971+08:00 2025-09-16 13:49:59.972 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:49:59.972+08:00 2025-09-16 13:49:59.973 INFO 9 --- [host-check-agent-status2,8d38e1e8121fec44,ac31c12216d1f767] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:49:59.973 INFO 9 --- [host-check-agent-status2,8d38e1e8121fec44,ac31c12216d1f767] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:49:59.973 INFO 9 --- [host-check-agent-status3,8d38e1e8121fec44,e2a5a6b77b0bacb8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:49:59.973 INFO 9 --- [host-check-agent-status3,8d38e1e8121fec44,e2a5a6b77b0bacb8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:49:59.973 INFO 9 --- [host-check-agent-status2,8d38e1e8121fec44,ac31c12216d1f767] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:49:59.973 INFO 9 --- [host-check-agent-status3,8d38e1e8121fec44,e2a5a6b77b0bacb8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status1,8d38e1e8121fec44,d944cc660c69f1a3] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status5,8d38e1e8121fec44,f6be5c31867670c1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status1,8d38e1e8121fec44,d944cc660c69f1a3] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status5,8d38e1e8121fec44,f6be5c31867670c1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status1,8d38e1e8121fec44,d944cc660c69f1a3] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status5,8d38e1e8121fec44,f6be5c31867670c1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status6,8d38e1e8121fec44,68a949683c5fb74a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status6,8d38e1e8121fec44,68a949683c5fb74a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:49:59.974 INFO 9 --- [host-check-agent-status6,8d38e1e8121fec44,68a949683c5fb74a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:49:59.975 INFO 9 --- [host-check-agent-status4,8d38e1e8121fec44,f08fc165029e05a4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:49:59.975 INFO 9 --- [host-check-agent-status4,8d38e1e8121fec44,f08fc165029e05a4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:49:59.975 INFO 9 --- [host-check-agent-status4,8d38e1e8121fec44,f08fc165029e05a4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:49:59.977 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:49:59.977 INFO 9 --- [ocp-schedules-27,8974ff7be40bbb8b,b0ecb2b25b8bf9d1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:49:59.978 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:49:59.970+08:00 and status AVAILABLE 2025-09-16 13:49:59.979 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:49:59.971+08:00 and status AVAILABLE 2025-09-16 13:49:59.980 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:49:59.971+08:00 and status AVAILABLE 2025-09-16 13:49:59.982 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:49:59.972+08:00 and status AVAILABLE 2025-09-16 13:49:59.982 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:49:59.982 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:49:59.971+08:00 and status AVAILABLE 2025-09-16 13:49:59.983 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:49:59.983 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:49:59.983 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:49:59.971+08:00 and status AVAILABLE 2025-09-16 13:49:59.984 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:49:59.985 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:49:59.987 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:49:59.988 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:49:59.989 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:49:59.989 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:49:59.989 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:49:59.990 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:49:59.990 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:49:59.990 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:49:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:49:59.991 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:49:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:49:59.991 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:49:59.992 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:49:59.992 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:49:59.993 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:00.003 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:00.004 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:00.004 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:00.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:50:00.003100+08:00, lastProcessTime=2025-09-16T13:49:50.004767+08:00 2025-09-16 13:50:00.004 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:00.006 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:00.007 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:00.030 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:00.031 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:50:00.032 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:50:00.033 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:50:00.033 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:00.034 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:50:00.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:50:00.035 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:50:00.038 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:50:00.039 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:50:00.039 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:50:00.039 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:50:00.040 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:50:00.042 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:50:00.045 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:50:00.056 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:00.057 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:00.057 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:00.058 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:00.058 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:00.060 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:00.070 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:00.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:50:00.076 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:00.078 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:50:00.079 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:00.084 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:50:00.085 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:50:00.085 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:50:00.086 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:50:00.087 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:50:00.087 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:50:00.091 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:50:00.091 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:50:00.092 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:50:00.092 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:50:00.094 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:50:00.094 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:50:00.097 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.097 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:00.104 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:00.105 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:00.105 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:00.106 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:00.107 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:00.107 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:00.116 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.116 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:00.131 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:50:00.132 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:50:00.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:00.132 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:50:00.134 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:50:00.136 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:50:00.137 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:50:00.003100+08:00 2025-09-16 13:50:00.139 INFO 9 --- [host-check-host-status3,e608aad22cba366b,a0ee87ed3d23fcaa] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:50:00.139 INFO 9 --- [host-check-host-status2,e608aad22cba366b,9c7183fff6cfa310] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:50:00.139 INFO 9 --- [host-check-host-status5,e608aad22cba366b,f34ec73878e0d2a5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:50:00.141 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:50:00.141 INFO 9 --- [host-check-host-status4,e608aad22cba366b,f580b4f0d29c0031] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:50:00.144 INFO 9 --- [host-check-host-status1,e608aad22cba366b,6560596628c4d14b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:50:00.147 INFO 9 --- [host-check-host-status6,e608aad22cba366b,f195797f6fae5311] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:50:00.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:00.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:00.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:00.180 INFO 9 --- [ocp-async-9,f02be10a7cbf33ae,f0cb3f0f45a70649] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:50:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:00.219 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.219 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:00.235 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:00.250 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:00.250 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:00.255 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:50:00.258 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:50:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:00.262 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:00.274 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:50:00.336 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:50:00.345 INFO 9 --- [ocp-schedules-26,95403147fe655fe4,202acfa175fc2a6c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:50:00.350 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:00.351 WARN 9 --- [scanner-1368044-1,95403147fe655fe4,95d081025b8e9a9b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:50:00.354 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:00.355 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:50:00.362 INFO 9 --- [alarm-detect-1,95403147fe655fe4,4e334645169d28c5] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:50:00.363 INFO 9 --- [alarm-detect-20,95403147fe655fe4,be0eefa0d58503e2] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:50:00.363 INFO 9 --- [alarm-detect-2,95403147fe655fe4,f8370215b58092d5] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:50:00.374 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:50:00.374 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:50:00.374 INFO 9 --- [ocp-schedules-8,15b9dfbcede59ca7,a0d85c6b93a68a89] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:50:00.377 INFO 9 --- [alarm-detect-8,95403147fe655fe4,0529ddc000e99758] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:50:00.450 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:00.450 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:00.651 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:45:01.0, nextRun=2025-09-16 13:50:00.0, currentDate=Tue Sep 16 13:50:00 CST 2025 2025-09-16 13:50:00.651 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999977, name=DiagFuncUpdateSchedule, templateName=DiagFuncUpdateSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:45:01.0, nextRunTime=2025-09-16 13:50:00.0} 2025-09-16 13:50:00.654 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=DiagFuncUpdateSchedule, nodeCount=1, taskCount=1 2025-09-16 13:50:00.654 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='DiagFuncUpdateSchedule', taskDefinitionId=999977, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T13:50:00.654+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Update diag function, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.diagnosis.task.DiagFuncUpdateTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 13:50:00.662 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:45:01.0, nextRun=2025-09-16 13:50:00.0, currentDate=Tue Sep 16 13:50:00 CST 2025 2025-09-16 13:50:00.662 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:45:01.0, nextRunTime=2025-09-16 13:50:00.0} 2025-09-16 13:50:00.677 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[1] 2025-09-16 13:50:00.695 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.p.s.internal.SqlParseTaskSchedule : HighRiskSql Parse is ready 2025-09-16 13:50:00.697 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=SqlParseTaskSchedule, nodeCount=1, taskCount=1 2025-09-16 13:50:00.697 INFO 9 --- [task-coordinator3,25e389618b93fdc9,207311d2d10677d5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='SqlParseTaskSchedule', taskDefinitionId=999985, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={cluster_ids=[[1]]}}, createTime=null, startTime=2025-09-16T13:50:00.697+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Sql Parse Task, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.task.SqlParseTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 13:50:00.776 WARN 9 --- [ocp-async-5,fd6ca1ddf870e20c,d4f10cb2a5dba93c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:00.776 INFO 9 --- [ocp-async-6,05ab350594a8897b,2b965d79fd8d5569] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:00.827 INFO 9 --- [ocp-schedules-5,70ca8b46acb6aeb4,ab17d69ad5888f75] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:50:00.889 INFO 9 --- [host-check-clockdiff4,a7089fc3117619a4,6417be64e04beedd] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001800 -1 -1 , error= 2025-09-16 13:50:00.889 INFO 9 --- [host-check-clockdiff2,a7089fc3117619a4,39d6729d089e1257] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001800 -1 -1 , error= 2025-09-16 13:50:00.889 INFO 9 --- [host-check-clockdiff3,a7089fc3117619a4,258b94c7ce96df63] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001800 -1 -1 , error= 2025-09-16 13:50:00.889 INFO 9 --- [host-check-clockdiff1,a7089fc3117619a4,f41bae27e3b86ccb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001800 -1 -1 , error= 2025-09-16 13:50:00.889 INFO 9 --- [host-check-clockdiff6,a7089fc3117619a4,657d3530ebbbb5e6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001800 -2 -2 , error= 2025-09-16 13:50:00.889 INFO 9 --- [host-check-clockdiff5,a7089fc3117619a4,ec8fb6269c073431] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001800 -1 -1 , error= 2025-09-16 13:50:01.150 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,000ca07ce8ac93b4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1344, operation:EXECUTE, state: RUNNING 2025-09-16 13:50:01.157 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,000ca07ce8ac93b4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1345, operation:EXECUTE, state: RUNNING 2025-09-16 13:50:01.161 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 13:50:01.162 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1344, context=Context{parallelIdx=-1, stringMap={task_instance_id=817, task_operation=execute, latest_execution_start_time=2025-09-16T13:50:01.147+08:00, sub_task_instance_name=Update diag function, sub_task_instance_id=1344}, listMap={}}, executor=10.233.116.22 2025-09-16 13:50:01.168 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 13:50:01.170 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1345, context=Context{parallelIdx=0, stringMap={subtask_splitter=cluster_ids, task_instance_id=818, task_operation=execute, latest_execution_start_time=2025-09-16T13:50:01.155+08:00, sub_task_instance_name=Sql Parse Task, sub_task_instance_id=1345}, listMap={cluster_ids=[[1]]}}, executor=10.233.116.22 2025-09-16 13:50:01.170 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.o.p.sql.internal.task.SqlParseTask : parse sql for cluster:1 2025-09-16 13:50:01.177 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.212 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1002,1757980800000000,2000,30000000 2025-09-16 13:50:01.215 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.o.perf.sql.internal.SqlParseService : parse 0 sqls for tenant:ObTenantEntity{id=2, name=cos, obTenantId=1002, status=NORMAL} 2025-09-16 13:50:01.228 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.245 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1004,1757980800000000,2000,30000000 2025-09-16 13:50:01.248 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.o.perf.sql.internal.SqlParseService : parse 0 sqls for tenant:ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL} 2025-09-16 13:50:01.253 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2d3effd9b2cf7540] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1345, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 13:50:01.256 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.293 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.317 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.341 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.367 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.376 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.o.DiskUsageTimeRemainingOperator : no metrics data, skip predicting for zhengqi 2025-09-16 13:50:01.377 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:50:01.424 INFO 9 --- [subtask-executor30,25e389618b93fdc9,51969487047ad44d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1344, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 13:50:01.636 INFO 9 --- [prometheus-minute-schedule-1,9f64a09873290972,a79d902fe99b5c34] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:01.639 INFO 9 --- [prometheus-minute-schedule-1,9f64a09873290972,a79d902fe99b5c34] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:01.709 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:817, status:SUCCESS 2025-09-16 13:50:01.709 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:817, status:SUCCESS 2025-09-16 13:50:01.714 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:818, status:SUCCESS 2025-09-16 13:50:01.715 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:818, status:SUCCESS 2025-09-16 13:50:02.776 WARN 9 --- [ocp-async-9,8a9d710217fbd987,82673179acb8b8a1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:02.776 INFO 9 --- [ocp-async-8,276d26d0c54fe9e6,c3357f19b4aeb253] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:03.450 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:03.451 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:04.636 INFO 9 --- [prometheus-minute-schedule-1,8a609612ffd13214,f878380e187d3489] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:04.640 INFO 9 --- [prometheus-minute-schedule-1,8a609612ffd13214,f878380e187d3489] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:04.679 INFO 9 --- [ocp-schedules-25,72e013e8446158a6,9910a8c148da4fd5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:50:04.771 INFO 9 --- [task-coordinator3,25e389618b93fdc9,faa02b16e61b7043] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:40:04.0, nextRun=2025-09-16 13:50:04.0, currentDate=Tue Sep 16 13:50:04 CST 2025 2025-09-16 13:50:04.771 INFO 9 --- [task-coordinator3,25e389618b93fdc9,faa02b16e61b7043] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999999, name=Partitioning daemon, templateName=PartitioningDaemonSchedule, scheduleRule=4 */10 * * * *, lastRunTime=2025-09-16 13:40:04.0, nextRunTime=2025-09-16 13:50:04.0} 2025-09-16 13:50:04.774 INFO 9 --- [task-coordinator3,25e389618b93fdc9,faa02b16e61b7043] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Partition rollover daemon, nodeCount=1, taskCount=1 2025-09-16 13:50:04.774 INFO 9 --- [task-coordinator3,25e389618b93fdc9,faa02b16e61b7043] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Partition rollover daemon', taskDefinitionId=999999, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T13:50:04.774+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Partition rollover daemon, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 13:50:04.776 WARN 9 --- [ocp-async-3,d7422a16a12a2450,77354c9155c7d830] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:04.776 INFO 9 --- [ocp-async-10,9920e0c0ade3da9f,d285e893d2fa1d88] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:05.173 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,cd31ddf89c091492] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1346, operation:EXECUTE, state: RUNNING 2025-09-16 13:50:05.185 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 13:50:05.185 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1346, context=Context{parallelIdx=-1, stringMap={task_instance_id=819, task_operation=execute, latest_execution_start_time=2025-09-16T13:50:05.172+08:00, sub_task_instance_name=Partition rollover daemon, sub_task_instance_id=1346}, listMap={}}, executor=10.233.116.22 2025-09-16 13:50:05.190 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2025-09-16 13:50:05.190 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2025-09-16 13:50:05.197 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.197 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:05.199 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.199 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.200 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.200 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2025-09-16 13:50:05.206 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.206 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.206 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.207 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_cache_info 2025-09-16 13:50:05.211 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2025-09-16 13:50:05.211 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2025-09-16 13:50:05.212 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.213 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:05.214 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.214 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.215 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.215 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2025-09-16 13:50:05.226 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.226 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.227 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.227 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_0 2025-09-16 13:50:05.238 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.239 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.239 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.239 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2025-09-16 13:50:05.249 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.249 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.250 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.250 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_1 2025-09-16 13:50:05.260 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.260 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.261 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.261 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2025-09-16 13:50:05.271 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.271 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.272 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.272 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_2 2025-09-16 13:50:05.282 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.282 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.283 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.283 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2025-09-16 13:50:05.293 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.293 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.294 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.294 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2025-09-16 13:50:05.300 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.300 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.300 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.301 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sqltext 2025-09-16 13:50:05.307 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.307 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.308 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.308 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_dynamic_sql 2025-09-16 13:50:05.313 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.313 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.314 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.314 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_high_risk_sql 2025-09-16 13:50:05.319 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.319 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.319 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.320 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2025-09-16 13:50:05.325 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.326 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.326 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.326 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_stat_0 2025-09-16 13:50:05.332 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.332 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.333 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.333 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2025-09-16 13:50:05.338 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.338 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.339 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.339 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan 2025-09-16 13:50:05.344 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.345 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.345 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.346 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2025-09-16 13:50:05.351 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.351 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.351 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.352 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_explain 2025-09-16 13:50:05.357 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.357 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.358 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.358 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2025-09-16 13:50:05.367 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.368 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.368 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.368 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_sample 2025-09-16 13:50:05.376 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.376 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.377 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.377 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample_statistics 2025-09-16 13:50:05.386 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.386 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.386 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.387 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2025-09-16 13:50:05.391 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.392 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.392 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.393 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2025-09-16 13:50:05.398 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.398 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.399 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.399 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2025-09-16 13:50:05.404 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.405 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.405 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.405 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2025-09-16 13:50:05.410 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.410 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.411 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.411 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2025-09-16 13:50:05.415 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.416 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.416 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.417 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2025-09-16 13:50:05.422 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.422 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.423 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.423 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2025-09-16 13:50:05.429 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.429 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.429 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.430 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2025-09-16 13:50:05.435 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.435 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.435 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.436 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2025-09-16 13:50:05.440 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.441 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.441 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.442 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2025-09-16 13:50:05.446 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.446 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.447 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.447 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2025-09-16 13:50:05.452 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.452 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.452 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.453 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2025-09-16 13:50:05.457 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.458 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.458 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.458 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2025-09-16 13:50:05.463 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.463 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.464 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.464 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2025-09-16 13:50:05.468 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.469 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.469 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.469 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2025-09-16 13:50:05.474 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.474 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.475 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.475 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2025-09-16 13:50:05.480 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.480 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.480 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.481 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2025-09-16 13:50:05.485 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.486 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.486 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.487 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2025-09-16 13:50:05.491 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.491 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.492 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.492 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2025-09-16 13:50:05.497 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.497 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.497 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.498 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_memory 2025-09-16 13:50:05.502 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.503 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.503 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.503 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_hit 2025-09-16 13:50:05.508 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.508 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.509 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.509 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2025-09-16 13:50:05.515 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.516 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.516 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.516 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_v2 2025-09-16 13:50:05.522 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.522 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.523 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.523 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2025-09-16 13:50:05.527 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.527 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.527 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.528 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_server_event 2025-09-16 13:50:05.531 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.532 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.532 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.533 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2025-09-16 13:50:05.537 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.537 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.537 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.538 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2025-09-16 13:50:05.542 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.542 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.543 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.543 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2025-09-16 13:50:05.548 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.548 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.549 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.549 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2025-09-16 13:50:05.553 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.554 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.554 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.554 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2025-09-16 13:50:05.559 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.559 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.559 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.560 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2025-09-16 13:50:05.564 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.565 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.565 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.565 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2025-09-16 13:50:05.570 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.570 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.571 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.571 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2025-09-16 13:50:05.575 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.576 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.576 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.577 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_async 2025-09-16 13:50:05.581 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.581 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.582 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.582 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2025-09-16 13:50:05.585 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.585 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.586 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.586 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2025-09-16 13:50:05.590 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.591 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:05.591 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:05.592 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2025-09-16 13:50:05.595 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2025-09-16 13:50:05.605 INFO 9 --- [subtask-executor30,25e389618b93fdc9,0269ea800f4f3307] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1346, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 13:50:05.727 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:819, status:SUCCESS 2025-09-16 13:50:05.728 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:819, status:SUCCESS 2025-09-16 13:50:06.451 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:06.451 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:06.776 WARN 9 --- [ocp-async-4,4845d88009c538aa,af5716512394ba92] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:06.776 INFO 9 --- [ocp-async-5,2e0df1c46b948081,33bdaa76f8c5e0aa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:07.636 INFO 9 --- [prometheus-minute-schedule-1,e2b09ba1629767e0,681674f40f569ff1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:07.639 INFO 9 --- [prometheus-minute-schedule-1,e2b09ba1629767e0,681674f40f569ff1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:08.776 WARN 9 --- [ocp-async-6,28ccc0c690a43fff,04cf676a12785890] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:08.776 INFO 9 --- [ocp-async-9,966f80895d9977cd,9de7997ff3eb96e5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:08.880 INFO 9 --- [ocp-schedules-20,ad14fa452aa8497e,a0276afffbc1fbbc] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:50:08.883 INFO 9 --- [ocp-schedules-20,ad14fa452aa8497e,a0276afffbc1fbbc] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:50:09.451 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:09.452 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:10.002 INFO 9 --- [ocp-schedules-3,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:50:10.003 INFO 9 --- [ocp-schedules-16,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:50:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:50:10.004300+08:00, lastProcessTime=2025-09-16T13:50:00.003100+08:00 2025-09-16 13:50:10.112 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:50:10.004300+08:00 2025-09-16 13:50:10.180 INFO 9 --- [ocp-async-1,a0979c1206497d5b,6637cc469da67e44] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:50:10.298 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:50:10.380 INFO 9 --- [ocp-schedules-11,bf524c6b988f3015,39dc84950b32f157] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:50:10.385 WARN 9 --- [scanner-1368302-1,bf524c6b988f3015,0b9bf3f3a68c8fa2] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:50:10.636 INFO 9 --- [prometheus-minute-schedule-1,c792f679fb334933,46d6b4de5068e8f7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:10.639 INFO 9 --- [prometheus-minute-schedule-1,c792f679fb334933,46d6b4de5068e8f7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:10.776 WARN 9 --- [ocp-async-7,3849ae43c5b7ec1e,41b0fe1c6323f982] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:10.776 INFO 9 --- [ocp-async-10,0c366d65e884174a,fd33f4ce562ea5ec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:11.707 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001740, nodeCount=460, affectRows=460 2025-09-16 13:50:12.452 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:12.453 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:12.776 WARN 9 --- [ocp-async-1,d8f87929b49307a9,d968b78a16db669b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:12.776 INFO 9 --- [ocp-async-5,580def7c7331886f,230257fb1d8041dd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:13.092 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001740, nodeCount=1000, affectRows=1000 2025-09-16 13:50:13.094 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001740, nodeCount=1000, validCount=996 2025-09-16 13:50:13.119 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001740, nodeCount=1000, affectRows=1000 2025-09-16 13:50:13.122 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001740, nodeCount=1000, validCount=998 2025-09-16 13:50:13.133 ERROR 9 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221684167) Duplicate entry '824401952612204544-1758001680' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221684167) Duplicate entry '824401952612204544-1758001680' for key 'PRIMARY' 2025-09-16 13:50:13.636 INFO 9 --- [prometheus-minute-schedule-1,df3bb78575ae1ca9,d28b34050f51f6ba] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:13.640 INFO 9 --- [prometheus-minute-schedule-1,df3bb78575ae1ca9,d28b34050f51f6ba] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:14.382 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001740, nodeCount=1000, affectRows=1000 2025-09-16 13:50:14.385 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001740, nodeCount=991, validCount=944 2025-09-16 13:50:14.408 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001740, nodeCount=853, affectRows=853 2025-09-16 13:50:14.410 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001740, nodeCount=853, validCount=852 2025-09-16 13:50:14.556 INFO 9 --- [ocp-schedules-11,a1c9e0486b5ac104,fb9ca18d4ad96d8f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:50:14.562 INFO 9 --- [ocp-schedules-11,a1c9e0486b5ac104,fb9ca18d4ad96d8f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:50:14.562 INFO 9 --- [ocp-schedules-11,a1c9e0486b5ac104,fb9ca18d4ad96d8f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:50:14.682 INFO 9 --- [ocp-schedules-21,d86770fb84e32200,17962add22465010] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:50:14.777 WARN 9 --- [ocp-async-6,273f1351c90dbe78,a2548141df5ef1a6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:14.777 INFO 9 --- [ocp-async-9,69412b2866e82e30,fe140c8c78116381] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:15.453 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:15.453 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:16.636 INFO 9 --- [prometheus-minute-schedule-1,6280f436e4e9ed15,f6ea05da4b081447] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:16.639 INFO 9 --- [prometheus-minute-schedule-1,6280f436e4e9ed15,f6ea05da4b081447] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:16.777 WARN 9 --- [ocp-async-8,df7404c716067a0a,849679da05364e0c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:16.777 INFO 9 --- [ocp-async-3,a47984872f932372,7839565b241d4609] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:18.453 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:18.454 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:18.777 WARN 9 --- [ocp-async-10,33a6b2aceac1781a,4c90411b06d2f9f2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:18.777 INFO 9 --- [ocp-async-4,7eb132adacafa4dc,379196b0e7a46586] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:18.887 INFO 9 --- [ocp-schedules-15,8cfb2ad6732946e1,822ed79401d40db5] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:50:18.889 INFO 9 --- [ocp-schedules-15,8cfb2ad6732946e1,822ed79401d40db5] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:50:19.636 INFO 9 --- [prometheus-minute-schedule-1,325ec0d7e3b8c259,cad3c565298b9cff] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:19.639 INFO 9 --- [prometheus-minute-schedule-1,325ec0d7e3b8c259,cad3c565298b9cff] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:50:20.004148+08:00, lastProcessTime=2025-09-16T13:50:10.004300+08:00 2025-09-16 13:50:20.114 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:50:20.004148+08:00 2025-09-16 13:50:20.180 INFO 9 --- [ocp-async-8,c8aca3fdc8c281ac,c92ea1a5d9c6af8f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:50:20.407 INFO 9 --- [ocp-schedules-4,9519ea9b4071b4c9,e9ac72d7ece163f3] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:50:20.412 WARN 9 --- [scanner-1369297-1,9519ea9b4071b4c9,e6a606ac0ae61d3e] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:50:20.422 INFO 9 --- [alarm-detect-9,9519ea9b4071b4c9,c3e39f9bde14294c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:50:20.424 INFO 9 --- [alarm-detect-13,9519ea9b4071b4c9,abbf025afac6c706] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:50:20.424 INFO 9 --- [alarm-detect-19,9519ea9b4071b4c9,96ef9ae10446d790] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:50:20.436 INFO 9 --- [alarm-detect-18,9519ea9b4071b4c9,30d81e050db46d4e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:50:20.636 INFO 9 --- [prometheus-cache-monitor1,fc8fc37c66232167,157b5e578f9cf4f3] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:50:20.636 INFO 9 --- [prometheus-cache-monitor1,fc8fc37c66232167,157b5e578f9cf4f3] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:50:20.777 WARN 9 --- [ocp-async-6,9b40bc486efbe96c,141485d364f2c980] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:20.777 INFO 9 --- [ocp-async-9,b94cb40b550db1e2,c4d41d2b6168416d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:21.454 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:21.454 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:22.636 INFO 9 --- [prometheus-minute-schedule-1,74c190ce81452ec1,59cb5fd86ef03b2c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:22.639 INFO 9 --- [prometheus-minute-schedule-1,74c190ce81452ec1,59cb5fd86ef03b2c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:22.777 WARN 9 --- [ocp-async-8,1367f590bdeee78a,c0756729b4b70fb8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:22.777 INFO 9 --- [ocp-async-3,6e1c747899708f34,4afccc95a6bcf0e0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:24.455 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:24.455 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:24.685 INFO 9 --- [ocp-schedules-8,1a371c6893447d31,7199ce94d20a016c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:50:24.777 WARN 9 --- [ocp-async-10,b1d48e63cc6a708e,eeb759a652f9410c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:24.777 INFO 9 --- [ocp-async-10,73419216b5675361,42702560a1c8efee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:25.636 INFO 9 --- [prometheus-minute-schedule-1,32e295c313810b04,f58bd77e4a47b9c2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:25.640 INFO 9 --- [prometheus-minute-schedule-1,32e295c313810b04,f58bd77e4a47b9c2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:26.777 WARN 9 --- [ocp-async-5,3d879153e0e41f7e,b31ddc7276e58754] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:26.777 INFO 9 --- [ocp-async-2,a7d7b99c2e1c1890,86324b76b5d903c6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:27.455 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:27.456 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:28.279 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,50ac45cb277a0297,0da8fcf00439e2cb] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=50ac45cb277a0297, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:50:28.279 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,50ac45cb277a0297,0da8fcf00439e2cb] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=50ac45cb277a0297, duration=1 ms] 2025-09-16 13:50:28.636 INFO 9 --- [prometheus-minute-schedule-1,471c163a9d7080e4,cdf0652c1f189705] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:28.639 INFO 9 --- [prometheus-minute-schedule-1,471c163a9d7080e4,cdf0652c1f189705] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:28.777 WARN 9 --- [ocp-async-9,3f8b9810f45848af,c6c72205d54b7e23] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:28.777 INFO 9 --- [ocp-async-7,7eee7cd8ee7715f2,576ebdb14c98c623] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:28.894 INFO 9 --- [ocp-schedules-18,c022e98b6572dbe2,d43ca24bd1b2dde2] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:50:28.896 INFO 9 --- [ocp-schedules-18,c022e98b6572dbe2,d43ca24bd1b2dde2] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:50:29.938 INFO 9 --- [ocp-schedules-27,80d61ddafb36bdba,f4acfda0e8a11403] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:50:29.941 INFO 9 --- [ocp-schedules-15,a12d1728b3537c10,b2994e482ff33446] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:50:29.941 INFO 9 --- [ocp-schedules-27,1715b5d71ad04b97,fc9f0383c1837da6] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:50:29.942 INFO 9 --- [ocp-schedules-4,5adcdf97e6190562,ab727e5bedf14fd5] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:50:29.943 INFO 9 --- [ocp-schedules-27,1715b5d71ad04b97,fc9f0383c1837da6] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:29.943 INFO 9 --- [ocp-schedules-15,a12d1728b3537c10,b2994e482ff33446] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:29.943 INFO 9 --- [ocp-schedules-4,5adcdf97e6190562,ab727e5bedf14fd5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:29.943 INFO 9 --- [ocp-schedules-4,5adcdf97e6190562,ab727e5bedf14fd5] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:50:29.944 INFO 9 --- [ocp-schedules-30,bbcd8b336a1f517a,08f9ad9888f8d363] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:29.944 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:50:29.944 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:50:29.944 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:50:29.944 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:50:29.945 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:50:29.945 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:50:29.945 INFO 9 --- [ocp-schedules-10,59917c2f24750cb5,a0431829d6199634] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:29.945 INFO 9 --- [ocp-schedules-19,e95d50a3e536831c,e16781062b3e6b93] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:29.945 INFO 9 --- [host-check-agent-status1,59917c2f24750cb5,8645ea87948b1e55] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:50:29.946 INFO 9 --- [host-check-agent-status2,59917c2f24750cb5,7882dc6aa496c8a2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:50:29.946 INFO 9 --- [host-check-agent-status3,59917c2f24750cb5,edd77fcdb0d12fa2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:50:29.946 INFO 9 --- [host-check-clockdiff1,e95d50a3e536831c,158978a9ac46a64b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:50:29.946 INFO 9 --- [host-check-agent-status4,59917c2f24750cb5,a644c9b13b6741c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:50:29.946 INFO 9 --- [host-check-agent-status5,59917c2f24750cb5,29e6446522dca002] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:50:29.946 INFO 9 --- [host-check-agent-status6,59917c2f24750cb5,156c511e867a9cce] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:50:29.946 INFO 9 --- [host-check-clockdiff2,e95d50a3e536831c,a92b278cc13d5154] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:50:29.946 INFO 9 --- [host-check-clockdiff3,e95d50a3e536831c,42169b6a87ba7d39] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:50:29.946 INFO 9 --- [host-check-clockdiff4,e95d50a3e536831c,8795e40b57e75a32] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:50:29.946 INFO 9 --- [host-check-clockdiff5,e95d50a3e536831c,98cd428d4130fb12] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:50:29.946 INFO 9 --- [host-check-clockdiff6,e95d50a3e536831c,585436afaf063aad] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:50:29.948 INFO 9 --- [ocp-schedules-11,933973556a125b8f,d1cd946473a10577] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:50:29.950 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:29.952 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:29.952 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:29.952 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:29.953 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:29.953 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:29.953 INFO 9 --- [host-check-clockdiff5,e95d50a3e536831c,98cd428d4130fb12] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001829 -1 -1 , error= 2025-09-16 13:50:29.953 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:29.954 INFO 9 --- [host-check-clockdiff4,e95d50a3e536831c,8795e40b57e75a32] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001829 0 0 , error= 2025-09-16 13:50:29.954 INFO 9 --- [host-check-clockdiff1,e95d50a3e536831c,158978a9ac46a64b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001829 -1 -1 , error= 2025-09-16 13:50:29.955 INFO 9 --- [host-check-agent-status2,59917c2f24750cb5,7882dc6aa496c8a2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:29.955 INFO 9 --- [host-check-agent-status1,59917c2f24750cb5,8645ea87948b1e55] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:29.955 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:29.955 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:50:29.955 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:29.955 INFO 9 --- [host-check-agent-status5,59917c2f24750cb5,29e6446522dca002] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:29.955 INFO 9 --- [host-check-agent-status3,59917c2f24750cb5,edd77fcdb0d12fa2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:29.955 INFO 9 --- [host-check-agent-status4,59917c2f24750cb5,a644c9b13b6741c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:29.955 INFO 9 --- [host-check-agent-status6,59917c2f24750cb5,156c511e867a9cce] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:29.955 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:29.955 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:29.955 INFO 9 --- [host-check-clockdiff2,e95d50a3e536831c,a92b278cc13d5154] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001829 -1 -1 , error= 2025-09-16 13:50:29.955 INFO 9 --- [host-check-clockdiff3,e95d50a3e536831c,42169b6a87ba7d39] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001829 -1 -1 , error= 2025-09-16 13:50:29.956 INFO 9 --- [host-check-agent-status2,59917c2f24750cb5,7882dc6aa496c8a2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:29.956 INFO 9 --- [host-check-agent-status1,59917c2f24750cb5,8645ea87948b1e55] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:29.956 INFO 9 --- [host-check-agent-status4,59917c2f24750cb5,a644c9b13b6741c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:29.956 INFO 9 --- [host-check-agent-status5,59917c2f24750cb5,29e6446522dca002] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:50:29.956 INFO 9 --- [host-check-agent-status3,59917c2f24750cb5,edd77fcdb0d12fa2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:29.957 INFO 9 --- [host-check-agent-status6,59917c2f24750cb5,156c511e867a9cce] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:29.962 INFO 9 --- [ocp-schedules-18,031660527d7f3041,18d2785e490b16b6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:50:29.963 INFO 9 --- [ocp-schedules-7,7729620491cf9908,1e8256c34ef7ea20] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:50:29.968 INFO 9 --- [ocp-schedules-18,031660527d7f3041,18d2785e490b16b6] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:50:29.969 INFO 9 --- [ocp-schedules-7,7729620491cf9908,1e8256c34ef7ea20] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:50:29.970 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:50:29.970 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:50:29.970 INFO 9 --- [host-check-agent-status1,59917c2f24750cb5,8645ea87948b1e55] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:50:29.971 INFO 9 --- [host-check-agent-status4,59917c2f24750cb5,a644c9b13b6741c6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:50:29.971 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:50:29.971 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:50:29.971 INFO 9 --- [host-check-agent-status2,59917c2f24750cb5,7882dc6aa496c8a2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:50:29.971 INFO 9 --- [host-check-agent-status3,59917c2f24750cb5,edd77fcdb0d12fa2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:50:29.971 INFO 9 --- [host-check-agent-status6,59917c2f24750cb5,156c511e867a9cce] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:50:29.972 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:50:29.971210833+08:00 2025-09-16 13:50:29.972 INFO 9 --- [host-check-agent-status5,59917c2f24750cb5,29e6446522dca002] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:50:29.972 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:50:29.971170313+08:00 2025-09-16 13:50:29.971 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:29.972 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:50:29.972 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:50:29.973 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:50:29.972+08:00 2025-09-16 13:50:29.973 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:50:29.972+08:00 2025-09-16 13:50:29.973 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:50:29.971764644+08:00 2025-09-16 13:50:29.973 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:50:29.971873216+08:00 2025-09-16 13:50:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:29.973 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:50:29.973+08:00 2025-09-16 13:50:29.973 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:50:29.972185450+08:00 2025-09-16 13:50:29.973 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:50:29.973+08:00 2025-09-16 13:50:29.974 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:50:29.972+08:00 and status AVAILABLE 2025-09-16 13:50:29.974 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:50:29.973400208+08:00 2025-09-16 13:50:29.974 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:50:29.973+08:00 2025-09-16 13:50:29.975 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:50:29.973+08:00 and status AVAILABLE 2025-09-16 13:50:29.975 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:50:29.972+08:00 and status AVAILABLE 2025-09-16 13:50:29.975 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:50:29.974+08:00 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status1,59917c2f24750cb5,8645ea87948b1e55] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status1,59917c2f24750cb5,8645ea87948b1e55] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status1,59917c2f24750cb5,8645ea87948b1e55] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:50:29.975 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:50:29.973+08:00 and status AVAILABLE 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status4,59917c2f24750cb5,a644c9b13b6741c6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status4,59917c2f24750cb5,a644c9b13b6741c6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status4,59917c2f24750cb5,a644c9b13b6741c6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status2,59917c2f24750cb5,7882dc6aa496c8a2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status2,59917c2f24750cb5,7882dc6aa496c8a2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:50:29.975 INFO 9 --- [host-check-agent-status2,59917c2f24750cb5,7882dc6aa496c8a2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status3,59917c2f24750cb5,edd77fcdb0d12fa2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status3,59917c2f24750cb5,edd77fcdb0d12fa2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status3,59917c2f24750cb5,edd77fcdb0d12fa2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:50:29.976 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:50:29.973+08:00 and status AVAILABLE 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status5,59917c2f24750cb5,29e6446522dca002] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status5,59917c2f24750cb5,29e6446522dca002] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status5,59917c2f24750cb5,29e6446522dca002] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status6,59917c2f24750cb5,156c511e867a9cce] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status6,59917c2f24750cb5,156c511e867a9cce] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:50:29.976 INFO 9 --- [host-check-agent-status6,59917c2f24750cb5,156c511e867a9cce] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:50:29.976 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:50:29.974+08:00 and status AVAILABLE 2025-09-16 13:50:29.978 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:50:29.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:50:29.979 INFO 9 --- [ocp-schedules-27,1715b5d71ad04b97,fc9f0383c1837da6] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:50:29.979 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:50:29.979 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:50:29.979 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:50:29.979 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:50:29.981 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:50:29.983 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:29.984 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:29.985 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:29.985 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:29.985 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:29.985 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:29.986 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:29.986 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:50:29.986 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:29.986 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:29.988 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:29.988 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:50:29.998 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:29.999 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:29.999 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:30.000 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:30.000 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:30.001 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:50:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:50:30.003645+08:00, lastProcessTime=2025-09-16T13:50:20.004148+08:00 2025-09-16 13:50:30.026 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:50:30.026 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:50:30.028 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:50:30.028 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:30.029 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:50:30.029 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:50:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:30.030 INFO 9 --- [ocp-schedules-28,602c66eaa7c0fed1,6c892ad4129f82df] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:50:30.030 INFO 9 --- [ocp-schedules-28,602c66eaa7c0fed1,6c892ad4129f82df] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:50:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:50:30.033 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:50:30.033 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:50:30.034 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:50:30.034 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:50:30.036 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:50:30.036 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:50:30.041 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:50:30.046 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:30.046 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:30.048 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:30.048 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:30.049 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:30.052 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:50:30.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:30.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:30.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:50:30.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:50:30.073 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:50:30.073 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:30.074 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:50:30.075 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:50:30.076 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:50:30.080 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:50:30.080 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:50:30.081 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:50:30.082 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:50:30.082 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:50:30.083 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:50:30.086 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:50:30.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:30.090 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:50:30.093 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:30.093 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:30.093 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:30.094 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:30.099 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:30.101 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:50:30.101 INFO 9 --- [prometheus-second-schedule-1,3e369bb75fc0892d,695a34e2f38e8cde] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:50:30.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:30.120 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:50:30.121 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:50:30.121 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:50:30.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:30.126 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:50:30.126 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:50:30.127 INFO 9 --- [host-check-host-status3,bbcd8b336a1f517a,29bace2074e3f2ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:50:30.127 INFO 9 --- [host-check-host-status2,bbcd8b336a1f517a,7ac4b7c862803aec] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:50:30.128 INFO 9 --- [host-check-host-status4,bbcd8b336a1f517a,7393c8cfb87c1ef4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:50:30.130 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:50:30.132 INFO 9 --- [host-check-host-status1,bbcd8b336a1f517a,3cdb657c3824c4fa] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:50:30.132 INFO 9 --- [host-check-host-status5,bbcd8b336a1f517a,64393998f658ae2e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:50:30.134 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:50:30.003645+08:00 2025-09-16 13:50:30.137 INFO 9 --- [host-check-host-status6,bbcd8b336a1f517a,e74aa092b201c624] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:50:30.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:30.153 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.153 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:30.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:30.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.180 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:30.181 INFO 9 --- [ocp-async-2,5438f42015e4c4cc,242d066bdf838f9c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:50:30.197 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.197 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:50:30.210 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.210 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:50:30.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:50:30.238 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:30.239 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:30.240 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:30.244 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:50:30.247 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:50:30.250 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:30.251 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:30.264 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:50:30.267 INFO 9 --- [ocp-schedules-17,d244b7d50ee23289,4f4cb30427580b4e] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:50:30.268 INFO 9 --- [ocp-schedules-17,d244b7d50ee23289,4f4cb30427580b4e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:30.268 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:50:30.268 INFO 9 --- [ocp-schedules-17,d244b7d50ee23289,4f4cb30427580b4e] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:50:30.325 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:50:30.339 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:30.341 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:30.342 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:50:30.356 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:50:30.356 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:50:30.356 INFO 9 --- [ocp-schedules-15,a12d1728b3537c10,b2994e482ff33446] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:50:30.394 INFO 9 --- [ocp-schedules-8,85bbcbd27d77e937,92f8e8939877fcfd] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:50:30.440 INFO 9 --- [ocp-schedules-26,e27d70c19a12cca7,57534bc0ba178ba7] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:50:30.445 WARN 9 --- [scanner-1369459-1,e27d70c19a12cca7,581ecd516dbef0bf] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:50:30.456 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:30.457 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:30.570 INFO 9 --- [ocp-schedules-5,d9d3e6be2f9fe9c3,fef62f8cc9b44a19] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:50:30.572 INFO 9 --- [ocp-schedules-5,d9d3e6be2f9fe9c3,fef62f8cc9b44a19] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:50:30.572 INFO 9 --- [ocp-schedules-5,d9d3e6be2f9fe9c3,fef62f8cc9b44a19] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:50:30.778 WARN 9 --- [ocp-async-5,02676a0fff5b41f8,df991f576398959e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:30.778 INFO 9 --- [ocp-async-6,8c8d957bdb950a23,2015c433e56458e6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:30.829 INFO 9 --- [ocp-schedules-24,c65922ad9efbcff2,5ebc33826d214296] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:50:30.887 INFO 9 --- [host-check-clockdiff6,e95d50a3e536831c,585436afaf063aad] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001830 -2 -2 , error= 2025-09-16 13:50:30.963 INFO 9 --- [ocp-schedules-13,45bc85ce93190b86,c3272edbba8838e8] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:50:30.963 INFO 9 --- [ocp-schedules-13,45bc85ce93190b86,c3272edbba8838e8] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:50:31.437 INFO 9 --- [ocp-schedules-2,0527a6f33f6475a4,1c0dca2f823dd537] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:50:31.437 INFO 9 --- [ocp-schedules-2,0527a6f33f6475a4,1c0dca2f823dd537] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001831 2025-09-16 13:50:31.455 INFO 9 --- [ocp-schedules-2,0527a6f33f6475a4,1c0dca2f823dd537] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:50:31.610 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2025-09-16 13:50:31.610 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2025-09-16 13:50:31.614 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2025-09-16 13:50:31.614 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: binlogQueryCache 2025-09-16 13:50:31.614 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.c.cache.helper.BinlogQueryCache : Init binlog cache. 2025-09-16 13:50:31.616 INFO 9 --- [ocp-schedules-8,7cb881d5db76427c,968b3726695cff11] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:50:31.619 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.c.cache.helper.BinlogQueryCache : Finish init binlog cache. 2025-09-16 13:50:31.619 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2025-09-16 13:50:31.619 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2025-09-16 13:50:31.627 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2025-09-16 13:50:31.627 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2025-09-16 13:50:31.627 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2025-09-16 13:50:31.629 INFO 9 --- [ocp-schedules-15,cb764f3195da3b39,671ff8a6ba1fc309] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2025-09-16 13:50:31.636 INFO 9 --- [prometheus-minute-schedule-1,68e8f8961803fb1b,46a0eefc66ead067] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:31.639 INFO 9 --- [prometheus-minute-schedule-1,68e8f8961803fb1b,46a0eefc66ead067] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:31.669 INFO 9 --- [ocp-schedules-26,90819dccd6387811,530ac87798ad98bc] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:50:31.679 INFO 9 --- [ocp-schedules-4,13b8e9722005b405,00ff1c88b59abe03] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:50:31.679 INFO 9 --- [ocp-schedules-4,13b8e9722005b405,00ff1c88b59abe03] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:50:31.682 INFO 9 --- [ocp-schedules-4,13b8e9722005b405,00ff1c88b59abe03] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:50:31.682 INFO 9 --- [ocp-schedules-4,13b8e9722005b405,00ff1c88b59abe03] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:50:31.684 INFO 9 --- [ocp-schedules-4,13b8e9722005b405,00ff1c88b59abe03] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:50:31.684 INFO 9 --- [ocp-schedules-4,13b8e9722005b405,00ff1c88b59abe03] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:50:31.734 INFO 9 --- [ocp-schedules-11,8862b3899a06c5a2,55b0750b238ba4a9] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:50:31.735 INFO 9 --- [ocp-schedules-11,8862b3899a06c5a2,55b0750b238ba4a9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:31.738 INFO 9 --- [ocp-schedules-5,02287cb1ba15fc62,6adc5eba84428be5] c.o.o.s.common.scheduled.PerfSchedules : Collect high risk sql audit stat, time=2025-09-16T13:50:31.738+08:00, tenantSize=3 2025-09-16 13:50:31.742 INFO 9 --- [ocp-schedules-5,02287cb1ba15fc62,6adc5eba84428be5] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3currentTimeUs:1758001831738000 2025-09-16 13:50:31.742 INFO 9 --- [ocp-schedules-5,02287cb1ba15fc62,6adc5eba84428be5] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3diagnosisStartTimeUs:1758001531693000 2025-09-16 13:50:31.751 INFO 9 --- [ocp-schedules-11,8862b3899a06c5a2,55b0750b238ba4a9] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:50:31.757 INFO 9 --- [ocp-schedules-5,02287cb1ba15fc62,6adc5eba84428be5] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3totalLength:0 2025-09-16 13:50:31.763 INFO 9 --- [ocp-schedules-5,02287cb1ba15fc62,6adc5eba84428be5] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2currentTimeUs:1758001831759000 2025-09-16 13:50:31.763 INFO 9 --- [ocp-schedules-5,02287cb1ba15fc62,6adc5eba84428be5] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2diagnosisStartTimeUs:1758001531715000 2025-09-16 13:50:31.777 INFO 9 --- [ocp-schedules-5,02287cb1ba15fc62,6adc5eba84428be5] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2totalLength:0 2025-09-16 13:50:32.778 WARN 9 --- [ocp-async-9,0325fa05b4bfe54f,42e4038c423eaddc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:32.778 INFO 9 --- [ocp-async-8,34aae8c3bcf8b9ed,46c03103dea1d446] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:33.364 INFO 9 --- [ocp-schedules-10,b40db61f0b52f1ff,7e147080f1c272de] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:50:33.457 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:33.458 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:33.494 INFO 9 --- [ocp-schedules-30,8a13c59b631f741d,167e015a2e69bec3] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:50:33.494+08:00, clusters=[1] 2025-09-16 13:50:33.496 INFO 9 --- [ocp-schedules-30,8a13c59b631f741d,167e015a2e69bec3] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:50:34.051 INFO 9 --- [ocp-schedules-25,f0b6d32d92739e26,c9bfcaeb784c68cb] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:50:34.051 INFO 9 --- [ocp-schedules-25,f0b6d32d92739e26,c9bfcaeb784c68cb] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:50:34.054 INFO 9 --- [ocp-schedules-25,f0b6d32d92739e26,c9bfcaeb784c68cb] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:50:34.069 INFO 9 --- [ocp-schedules-25,f0b6d32d92739e26,c9bfcaeb784c68cb] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:50:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:50:34.564 INFO 9 --- [ocp-schedules-3,26f857fee14c5183,612a68cf3336e58b] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:50:34.568 INFO 9 --- [ocp-schedules-3,26f857fee14c5183,612a68cf3336e58b] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:50:34.568 INFO 9 --- [ocp-schedules-3,26f857fee14c5183,612a68cf3336e58b] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:50:34.636 INFO 9 --- [prometheus-minute-schedule-1,6a325b86e4bf6c7a,c02ff3600d6ee8b1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:34.639 INFO 9 --- [prometheus-minute-schedule-1,6a325b86e4bf6c7a,c02ff3600d6ee8b1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:34.689 INFO 9 --- [ocp-schedules-17,fc01110fb91c23f0,be5a5d7fcfd2c612] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:50:34.778 WARN 9 --- [ocp-async-3,25beb234d8ada298,9ece87942e0ec956] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:34.778 INFO 9 --- [ocp-async-4,84d5fdff87d25e31,bc8b7180f5b52983] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:35.532 INFO 9 --- [ocp-schedules-24,bfcebceb1d47486e,ccb8499ad677b00b] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:50:35.532+08:00, clusters=[1] 2025-09-16 13:50:35.536 INFO 9 --- [ocp-schedules-24,bfcebceb1d47486e,ccb8499ad677b00b] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:50:35.918 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:35.918 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=10 2025-09-16 13:50:35.919 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=8 2025-09-16 13:50:35.919 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=11 2025-09-16 13:50:35.919 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=12 2025-09-16 13:50:35.919 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=7 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_retry_remove_parts, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_fail_check_localserver, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_mem_alloc_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_server_hang_due_to_trx_lock, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_rootservice_stop_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_parse_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_refresh_schema_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_alloc_oops, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_invalid_lock, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_assemble_rpc_lock, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_global_trans_version_delay, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_server_local_ip_invalid, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_common_unexpected_internal_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clock_unsync, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_major_freeze_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_distributed_strong_read, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_reply_memstore_failed, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_rootservice_start_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_write_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType rootservice_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_error_lib_direct_alloc, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_merge_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_fetch_rs_url_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_partition_overlimit, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_rootservice_destroy_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_max_open_files, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_worker_thread_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_mysql_request_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_trx_context_not_release, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_checksum_mismatch, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_replica_minority, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_unknown_checksum_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_online_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_no_valid_parti, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_meta_inconsistent, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rpc_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_network_unreachable, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_tx_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_too_many_sstables, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_right_to_die, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_cant_daily_merge, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_voting_success, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_virtual_group_elect_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_thread_hang, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_microblock_read0, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_merge_error_4184, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_dump_queue_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType election_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_unit_migrate_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_commit_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_easy_hold_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_row_count_notsame, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_restart_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_io_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_server_disk_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_merge_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType observer_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_disk_almost_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_timer_cost_much, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.959 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_disk_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_decent_voting, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_get_events_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_checksum_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rpc_blocklist, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clock_diff_time_too_large, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_server_service_start_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_system_disk_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType refresh_location_cache_failed, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_crash_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_ps_checksum_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rpc_fly_slow, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_err_defensive_check, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_renew_location_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.960 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_server_stop_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 13:50:35.961 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 7 agent sql collect property 2025-09-16 13:50:35.961 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:35.963 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.159 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.159 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.159 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.111 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.111 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.54 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.111 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.54 2025-09-16 13:50:35.970 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.54 2025-09-16 13:50:35.970 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.104 2025-09-16 13:50:35.970 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.104 2025-09-16 13:50:35.970 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.104 2025-09-16 13:50:35.971 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 12 agent sql collect property 2025-09-16 13:50:35.971 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 11 agent sql collect property 2025-09-16 13:50:35.972 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 8 agent sql collect property 2025-09-16 13:50:35.972 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 10 agent sql collect property 2025-09-16 13:50:35.980 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:35.980 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:35.981 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:35.981 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:35.982 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:35.982 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (logtailer.log.filter.rules.json.content=[{"alarmTemplateId":0,"alarmType":"message_hardware_error","durationSeconds":0,"evaluationIntervalSeconds":0,"excludeKeywords":[],"excludeKeywordsRelation":"Or","expression":{"metric":"os_message_log"},"expressionType":"Log","includeKeywords":["Hardware Error"],"includeKeywordsRelation":"Or","level":2,"logLevels":[],"resolvedTimeoutSeconds":300},{"alarmTemplateId":0,"alarmType":"message_log_alarm","durationSeconds":0,"evaluationIntervalSeconds":0,"excludeKeywords":[],"excludeKeywordsRelation":"Or","expression":{"metric":"os_message_log"},"expressionType":"Log","includeKeywords":["kernel: nvme.*timeout"],"includeKeywordsRelation":"Or","level":2,"logLevels":[],"resolvedTimeoutSeconds":300},{"alarmTemplateId":0,"alarmType":"odp_instance_compress_failed","durationSeconds":0,"evaluationIntervalSeconds":60,"excludeKeywords":[],"expression":{"metric":"instance_compress_failed_count","op":">","threshold":0.00},"expressionType":"LogStat","includeKeywords":[],"level":2,"logLevels":[],"resolvedTimeoutSeconds":300},{"alarmTemplateId":0,"alarmType":"odp_instance_expanse_failed","durationSeconds":0,"evaluationIntervalSeconds":60,"excludeKeywords":[],"expression":{"metric":"instance_expanse_failed_count","op":">","threshold":0.00},"expressionType":"LogStat","includeKeywords":[],"level":2,"logLevels":[],"resolvedTimeoutSeconds":300}]), (monagent.pipeline.ob.trace.status=inactive), (monagent.pipeline.ob.log.status=inactive)]), params:null 2025-09-16 13:50:35.982 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:50:35.983 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:35.983 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:35.998 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 7, do nothing 2025-09-16 13:50:35.999 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=9 2025-09-16 13:50:36.001 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone2), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.111), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.111:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_l 2025-09-16 13:50:36.001 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone1), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.159), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.159:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_l 2025-09-16 13:50:36.002 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone5), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.54), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.54:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_log. 2025-09-16 13:50:36.002 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone3), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.104), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.104:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_l 2025-09-16 13:50:36.020 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 12, do nothing 2025-09-16 13:50:36.020 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 11, do nothing 2025-09-16 13:50:36.020 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 8, do nothing 2025-09-16 13:50:36.029 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 10, do nothing 2025-09-16 13:50:36.047 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.85 2025-09-16 13:50:36.047 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.85 2025-09-16 13:50:36.048 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.85 2025-09-16 13:50:36.049 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 9 agent sql collect property 2025-09-16 13:50:36.057 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:36.059 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:36.077 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone4), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.85), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.85:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_log. 2025-09-16 13:50:36.100 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 9, do nothing 2025-09-16 13:50:36.101 INFO 9 --- [ocp-schedules-13,96ceeb602a8ff900,c571d521630e8490] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config finished 2025-09-16 13:50:36.458 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:36.458 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:36.778 WARN 9 --- [ocp-async-5,2955b9e246217bce,4c2d25db0515e5c8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:36.778 INFO 9 --- [ocp-async-1,b6992b20abe49b6b,bc1decf8a37238fc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:37.636 INFO 9 --- [prometheus-minute-schedule-1,127bbd23a3383b24,28681faacd415179] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:37.639 INFO 9 --- [prometheus-minute-schedule-1,127bbd23a3383b24,28681faacd415179] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:37.665 INFO 9 --- [ocp-schedules-13,0eb5ed8ff64237f9,8e43a531c1c028d2] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:50:37.667 INFO 9 --- [ocp-schedules-13,0eb5ed8ff64237f9,8e43a531c1c028d2] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:37.686 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:37.686 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:50:37.699 INFO 9 --- [ocp-schedules-13,0eb5ed8ff64237f9,8e43a531c1c028d2] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:50:38.778 WARN 9 --- [ocp-async-9,8892993cf4be0ff3,09ba0033698dbe7d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:38.778 INFO 9 --- [ocp-async-2,526d3d34890bea56,6a9196780ae88c7c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:38.902 INFO 9 --- [ocp-schedules-2,aecf5b63425ee7e0,6a412b9f8606cbbd] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:50:38.904 INFO 9 --- [ocp-schedules-2,aecf5b63425ee7e0,6a412b9f8606cbbd] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:50:39.006 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2025-09-16 13:50:39.006 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2025-09-16 13:50:39.007 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.007 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:39.009 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.009 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.009 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.010 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2025-09-16 13:50:39.015 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.016 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.016 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.016 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_cache_info 2025-09-16 13:50:39.020 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2025-09-16 13:50:39.020 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2025-09-16 13:50:39.021 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.022 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:39.023 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.023 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.024 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.024 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2025-09-16 13:50:39.035 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.035 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.036 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.036 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_0 2025-09-16 13:50:39.047 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.047 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.048 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.048 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2025-09-16 13:50:39.057 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.058 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.058 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.058 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_1 2025-09-16 13:50:39.068 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.068 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.068 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.069 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2025-09-16 13:50:39.078 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.079 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.079 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.079 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_2 2025-09-16 13:50:39.089 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.090 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.090 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.090 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2025-09-16 13:50:39.100 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.100 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.101 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.101 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2025-09-16 13:50:39.106 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.107 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.107 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.107 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sqltext 2025-09-16 13:50:39.113 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.113 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.114 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.114 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_dynamic_sql 2025-09-16 13:50:39.118 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.119 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.119 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.120 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_high_risk_sql 2025-09-16 13:50:39.124 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.124 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.125 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.125 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2025-09-16 13:50:39.131 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.131 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.131 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.132 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_stat_0 2025-09-16 13:50:39.137 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.138 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.138 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.138 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2025-09-16 13:50:39.143 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.144 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.144 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.144 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan 2025-09-16 13:50:39.150 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.150 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.151 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.151 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2025-09-16 13:50:39.156 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.156 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.157 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.157 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_explain 2025-09-16 13:50:39.162 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.162 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.163 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.163 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2025-09-16 13:50:39.170 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.170 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.171 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.171 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_sample 2025-09-16 13:50:39.178 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.179 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.179 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.179 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample_statistics 2025-09-16 13:50:39.188 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.188 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.189 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.189 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2025-09-16 13:50:39.194 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.194 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.195 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.195 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2025-09-16 13:50:39.201 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.201 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.201 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.202 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2025-09-16 13:50:39.206 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.207 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.207 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.207 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2025-09-16 13:50:39.212 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.212 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.212 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.213 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2025-09-16 13:50:39.217 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.217 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.218 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.218 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2025-09-16 13:50:39.223 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.223 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.223 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.224 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2025-09-16 13:50:39.228 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.229 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.229 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.229 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2025-09-16 13:50:39.234 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.234 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.235 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.235 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2025-09-16 13:50:39.240 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.240 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.241 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.241 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2025-09-16 13:50:39.245 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.246 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.246 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.246 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2025-09-16 13:50:39.251 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.251 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.252 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.252 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2025-09-16 13:50:39.256 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.256 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.257 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.257 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2025-09-16 13:50:39.261 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.262 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.262 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.262 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2025-09-16 13:50:39.267 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.267 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.267 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.268 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2025-09-16 13:50:39.272 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.273 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.273 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.273 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2025-09-16 13:50:39.278 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.278 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.278 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.279 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2025-09-16 13:50:39.283 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.283 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.284 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.284 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2025-09-16 13:50:39.289 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.289 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.290 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.290 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2025-09-16 13:50:39.294 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.295 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.295 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.296 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_memory 2025-09-16 13:50:39.300 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.300 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.301 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.301 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_hit 2025-09-16 13:50:39.305 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.306 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.306 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.307 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2025-09-16 13:50:39.312 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.313 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.313 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.314 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_v2 2025-09-16 13:50:39.319 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.319 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.319 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.320 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2025-09-16 13:50:39.324 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.324 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.324 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.325 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_server_event 2025-09-16 13:50:39.330 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.331 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.331 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.331 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2025-09-16 13:50:39.336 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.336 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.336 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.337 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2025-09-16 13:50:39.341 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.342 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.342 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.342 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2025-09-16 13:50:39.346 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.347 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.347 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.347 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2025-09-16 13:50:39.351 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.352 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.352 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.352 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2025-09-16 13:50:39.357 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.357 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.357 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.358 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2025-09-16 13:50:39.362 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.362 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.363 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.363 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2025-09-16 13:50:39.367 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.368 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.368 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.369 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2025-09-16 13:50:39.373 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.373 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.373 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.374 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_async 2025-09-16 13:50:39.378 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.378 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.379 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.379 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2025-09-16 13:50:39.382 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.382 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.383 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.383 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2025-09-16 13:50:39.387 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.387 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:39.388 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.388 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2025-09-16 13:50:39.391 INFO 9 --- [ocp-schedules-3,29fcc373f20eb8be,5471601a63b47b26] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2025-09-16 13:50:39.458 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:39.459 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:39.687 INFO 9 --- [ocp-schedules-23,ffd78a614ac4894a,a05002b5b0c2f638] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:50:39.687 INFO 9 --- [ocp-schedules-23,ffd78a614ac4894a,a05002b5b0c2f638] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:50:39.700 INFO 9 --- [ocp-schedules-24,4478bee053004454,643f863a5d363232] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:39.700 INFO 9 --- [ocp-schedules-24,4478bee053004454,643f863a5d363232] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:50:39.700 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:50:39.700 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:50:39.700 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:50:39.700 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:50:39.703 INFO 9 --- [Collect all tenants major compactions1,ffd78a614ac4894a,6814be88b8f849ff] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:50:39.703 INFO 9 --- [Collect all tenants major compactions3,ffd78a614ac4894a,48c592116ab3628f] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:50:39.704 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:39.704 INFO 9 --- [Collect all tenants major compactions2,ffd78a614ac4894a,9825dea9a7c00250] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:50:39.704 INFO 9 --- [ocp-schedules-24,4478bee053004454,643f863a5d363232] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:39.704 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:39.704 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:39.704 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:39.705 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:39.705 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:39.705 INFO 9 --- [ocp-schedules-24,4478bee053004454,643f863a5d363232] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:39.705 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:39.705 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:39.719 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:50:39.719 INFO 9 --- [ocp-schedules-24,4478bee053004454,643f863a5d363232] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:50:39.719 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:50:39.719 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:50:39.719 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:50:39.720 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:50:39.723 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:39.724 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:50:39.724 INFO 9 --- [Collect all tenants major compactions3,ffd78a614ac4894a,48c592116ab3628f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.726 INFO 9 --- [Collect all tenants major compactions3,ffd78a614ac4894a,48c592116ab3628f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:50:39.726 INFO 9 --- [Collect all tenants major compactions1,ffd78a614ac4894a,6814be88b8f849ff] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.726 INFO 9 --- [Collect all tenants major compactions2,ffd78a614ac4894a,9825dea9a7c00250] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:39.727 INFO 9 --- [Collect all tenants major compactions1,ffd78a614ac4894a,6814be88b8f849ff] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:50:39.728 INFO 9 --- [Collect all tenants major compactions2,ffd78a614ac4894a,9825dea9a7c00250] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:50:39.730 INFO 9 --- [Collect all tenants major compactions1,ffd78a614ac4894a,6814be88b8f849ff] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:50:39.730 INFO 9 --- [Collect all tenants major compactions3,ffd78a614ac4894a,48c592116ab3628f] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:50:39.735 INFO 9 --- [Collect all tenants major compactions2,ffd78a614ac4894a,9825dea9a7c00250] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:50:39.736 INFO 9 --- [ocp-schedules-23,ffd78a614ac4894a,a05002b5b0c2f638] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:50:39.737 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:50:39.738 INFO 9 --- [ocp-schedules-24,4478bee053004454,643f863a5d363232] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:50:40.002 INFO 9 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:50:40.002 INFO 9 --- [ocp-schedules-20,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:50:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:50:40.003820+08:00, lastProcessTime=2025-09-16T13:50:30.003645+08:00 2025-09-16 13:50:40.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:50:40.003820+08:00 2025-09-16 13:50:40.181 INFO 9 --- [ocp-async-10,8a305f3990bfd1ae,ca53f48555cafa20] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:50:40.467 INFO 9 --- [ocp-schedules-16,e632856b4c33be06,31cd9caa303e6568] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:50:40.472 WARN 9 --- [scanner-1369586-1,e632856b4c33be06,a75bdba2e25a73cc] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:50:40.482 INFO 9 --- [alarm-detect-13,e632856b4c33be06,4e7b78ea020da2d1] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:50:40.484 INFO 9 --- [alarm-detect-9,e632856b4c33be06,d0f6147ffc3f3bf9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:50:40.484 INFO 9 --- [alarm-detect-14,e632856b4c33be06,49c2a9ed993fc647] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:50:40.496 INFO 9 --- [alarm-detect-3,e632856b4c33be06,e8a2e7a3c640f73a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:50:40.636 INFO 9 --- [prometheus-minute-schedule-1,39c31f0caf49d99c,b3e801d6ec2706b3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:40.639 INFO 9 --- [prometheus-minute-schedule-1,39c31f0caf49d99c,b3e801d6ec2706b3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:40.778 WARN 9 --- [ocp-async-4,738d4e4af7d2cf41,728226d0a2ae8d48] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:40.778 INFO 9 --- [ocp-async-5,c8a409750e252a06,e63266de11fbfda0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:42.118 INFO 9 --- [ocp-schedules-19,e5742e76924713c1,c2cd0b123d2411f9] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:50:42.118 INFO 9 --- [ocp-schedules-19,e5742e76924713c1,c2cd0b123d2411f9] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:50:42.156 INFO 9 --- [ocp-schedules-19,e5742e76924713c1,c2cd0b123d2411f9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:42.157 INFO 9 --- [ocp-schedules-19,e5742e76924713c1,c2cd0b123d2411f9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:50:42.459 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:42.460 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:42.778 WARN 9 --- [ocp-async-1,f16ca28b5b19835b,2e28676a6f90b60f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:42.778 INFO 9 --- [ocp-async-9,123400caac81b751,cb4c287eaedc50e0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:43.262 INFO 9 --- [ocp-schedules-12,97664b7bbaf99989,409a17f715016785] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:50:43.264 INFO 9 --- [ocp-schedules-12,97664b7bbaf99989,409a17f715016785] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:43.312 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:50:43.313 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.315 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:50:43.341 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.342 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:50:43.365 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.366 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:50:43.390 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.391 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:50:43.394 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.394 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:50:43.418 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.419 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:50:43.442 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.442 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:50:43.447 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.447 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:50:43.469 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.470 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:50:43.493 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.493 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:50:43.517 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.518 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:50:43.519 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.520 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:50:43.521 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.522 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:50:43.522 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.523 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:50:43.524 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.524 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:50:43.525 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.526 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:50:43.543 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.544 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:50:43.544 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.545 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:50:43.546 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.547 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:50:43.563 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:50:43.567 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:50:43.594 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:50:43.595 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:43.596 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:50:43.629 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:50:43.629 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:50:43.629 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:50:43.629 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:50:43.629 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:50:43.629 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:50:43.631 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:50:43.631 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:50:43.631 INFO 9 --- [ocp-schedules-12,97664b7bbaf99989,409a17f715016785] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:50:43.636 INFO 9 --- [prometheus-minute-schedule-1,c25db884e3908cc5,e1c0ecd474d5b5d8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:43.639 INFO 9 --- [prometheus-minute-schedule-1,c25db884e3908cc5,e1c0ecd474d5b5d8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:44.692 INFO 9 --- [ocp-schedules-27,90707d421f5a0743,01eb786f9848013b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:50:44.778 WARN 9 --- [ocp-async-6,8185dfbb9d2f06ae,6e39653c66c0c6ca] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:44.778 INFO 9 --- [ocp-async-2,84cfbcb745147692,6faff7f1168d1de9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:50:44,939 |-INFO in ReconfigureOnChangeTask(born:1758001784939) - Empty watch file list. Disabling 2025-09-16 13:50:45.460 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:45.461 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:46.636 INFO 9 --- [prometheus-minute-schedule-1,3cb14de06102ac71,cd9b6cb6ce39c1b5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:46.639 INFO 9 --- [prometheus-minute-schedule-1,3cb14de06102ac71,cd9b6cb6ce39c1b5] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:46.778 WARN 9 --- [ocp-async-3,ae38cc17e68940d8,84f21b0b51bff6a7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:46.779 INFO 9 --- [ocp-async-4,911ad227805d2a53,e942a9da77c52ccf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:48.461 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:48.462 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:48.779 WARN 9 --- [ocp-async-5,28351ba529552359,af077e9fedffe6b1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:48.779 INFO 9 --- [ocp-async-1,5f5ee339bfc20cb7,d97285d7a9de55bb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:48.908 INFO 9 --- [ocp-schedules-10,3b4a211760c8d018,33bb60e65fc1f0e6] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:50:48.910 INFO 9 --- [ocp-schedules-10,3b4a211760c8d018,33bb60e65fc1f0e6] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:50:49.224 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.225 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:49.226 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.227 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:49.228 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:50:49.243 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:50:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:50:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:50:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:50:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:50:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:50:49.258 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.258 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.258 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.258 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.258 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.259 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:49.259 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:49.259 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:49.259 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:49.259 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:49.260 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.260 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.260 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.260 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.260 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:49.260 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:49.261 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:49.261 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:49.261 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:49.262 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:50:49.280 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:48:30, start=2025-09-16T13:45:00, end=2025-09-16T13:47:30, updates=79, granule=120000ms, delay=210000ms 2025-09-16 13:50:49.282 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:48:30, start=2025-09-16T13:45:00, end=2025-09-16T13:47:30, updates=75, granule=120000ms, delay=210000ms 2025-09-16 13:50:49.286 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:48:30, target=2025-09-16T13:47:30, granule=120000ms, delay=60000ms) 2025-09-16 13:50:49.286 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:47:30, target=2025-09-16T13:37:30, granule=600000ms, delay=600000ms) 2025-09-16 13:50:49.286 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:48:30, start=2025-09-16T13:45:00, end=2025-09-16T13:47:30, updates=106, granule=120000ms, delay=210000ms 2025-09-16 13:50:49.286 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:48:30, target=2025-09-16T13:47:30, granule=120000ms, delay=60000ms) 2025-09-16 13:50:49.286 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:48:30, start=2025-09-16T13:45:00, end=2025-09-16T13:47:30, updates=138, granule=120000ms, delay=210000ms 2025-09-16 13:50:49.286 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:47:30, target=2025-09-16T13:37:30, granule=600000ms, delay=600000ms) 2025-09-16 13:50:49.289 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:48:30, target=2025-09-16T13:47:30, granule=120000ms, delay=60000ms) 2025-09-16 13:50:49.289 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:47:30, target=2025-09-16T13:37:30, granule=600000ms, delay=600000ms) 2025-09-16 13:50:49.291 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:48:30, target=2025-09-16T13:47:30, granule=120000ms, delay=60000ms) 2025-09-16 13:50:49.291 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:47:30, target=2025-09-16T13:37:30, granule=600000ms, delay=600000ms) 2025-09-16 13:50:49.293 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:48:30, start=2025-09-16T13:45:00, end=2025-09-16T13:47:30, updates=195, granule=120000ms, delay=210000ms 2025-09-16 13:50:49.298 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:48:30, target=2025-09-16T13:47:30, granule=120000ms, delay=60000ms) 2025-09-16 13:50:49.298 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:47:30, target=2025-09-16T13:37:30, granule=600000ms, delay=600000ms) 2025-09-16 13:50:49.298 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=70ms, period=120000ms 2025-09-16 13:50:49.636 INFO 9 --- [prometheus-minute-schedule-1,54ae3d155a2d0ac5,8b08464427b369d4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:49.639 INFO 9 --- [prometheus-minute-schedule-1,54ae3d155a2d0ac5,8b08464427b369d4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:50:50.003039+08:00, lastProcessTime=2025-09-16T13:50:40.003820+08:00 2025-09-16 13:50:50.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:50:50.003039+08:00 2025-09-16 13:50:50.181 INFO 9 --- [ocp-async-3,b0a1facb7150daf3,495d1991184ce768] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:50:50.500 INFO 9 --- [ocp-schedules-8,d771c327d526812d,ca533cd8cece6ad1] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:50:50.504 WARN 9 --- [scanner-1369749-1,d771c327d526812d,88f0f608eb85692b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:50:50.779 WARN 9 --- [ocp-async-6,fc219cb558db1daf,be0085b2d0b40e1a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:50.779 INFO 9 --- [ocp-async-9,9cd6bdf45d764003,3360f35058609ce4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:51.462 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:51.463 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:52.636 INFO 9 --- [prometheus-minute-schedule-1,4585f32b003cff30,e9ebefc953745346] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:52.639 INFO 9 --- [prometheus-minute-schedule-1,4585f32b003cff30,e9ebefc953745346] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:52.779 WARN 9 --- [ocp-async-9,30809ee53ef2926c,280c01cea1dd127b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:52.779 INFO 9 --- [ocp-async-2,8409117a38dcff12,9501c88ae794260e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:54.463 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:54.464 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:54.571 INFO 9 --- [ocp-schedules-5,cdd8242e46346b23,3862763fb592665e] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:50:54.576 INFO 9 --- [ocp-schedules-5,cdd8242e46346b23,3862763fb592665e] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:50:54.576 INFO 9 --- [ocp-schedules-5,cdd8242e46346b23,3862763fb592665e] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:50:54.696 INFO 9 --- [ocp-schedules-22,508192a0eb1ac742,06ab96a5068cd6dd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:50:54.779 WARN 9 --- [ocp-async-2,e8d2bef02f132eee,f758557e8b617a62] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:54.779 INFO 9 --- [ocp-async-10,fd39756c934283e1,ea9ec8c239145e3c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:55.636 INFO 9 --- [prometheus-minute-schedule-1,84395478443756ce,7c5255cc2bda0660] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:55.639 INFO 9 --- [prometheus-minute-schedule-1,84395478443756ce,7c5255cc2bda0660] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:56.779 WARN 9 --- [ocp-async-10,7cb89bbbd0538bf2,cdf71aead9c6ddab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:56.779 INFO 9 --- [ocp-async-10,8d50cdb200999d05,4c206dbc6561e3db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:57.464 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:50:57.465 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:50:58.636 INFO 9 --- [prometheus-minute-schedule-1,f697849b7a3ae8b5,de1a218df8ce54c2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001860, interval=60 2025-09-16 13:50:58.639 INFO 9 --- [prometheus-minute-schedule-1,f697849b7a3ae8b5,de1a218df8ce54c2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:50:58.779 WARN 9 --- [ocp-async-7,1e59b3d27f11a4b5,dbb498b11491443d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:50:58.779 INFO 9 --- [ocp-async-3,0019775371c088ef,313f0bd845a257a1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:50:58.914 INFO 9 --- [ocp-schedules-24,99c97a905415b9c1,ebdb57790f7a1d42] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:50:58.916 INFO 9 --- [ocp-schedules-24,99c97a905415b9c1,ebdb57790f7a1d42] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:50:59.938 INFO 9 --- [ocp-schedules-27,49578160dad8681e,aaf4ecb1904e9187] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:50:59.941 INFO 9 --- [ocp-schedules-27,fe4c01f22f036977,7d5a9fd67750c84b] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:50:59.941 INFO 9 --- [ocp-schedules-23,70caab2c1bbd5769,31640a60e5261d8f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:50:59.942 INFO 9 --- [ocp-schedules-14,ade3276949b3efbf,0dc5195508d92e99] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:50:59.942 INFO 9 --- [ocp-schedules-27,fe4c01f22f036977,7d5a9fd67750c84b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:59.943 INFO 9 --- [ocp-schedules-23,70caab2c1bbd5769,31640a60e5261d8f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:59.943 INFO 9 --- [ocp-schedules-14,ade3276949b3efbf,0dc5195508d92e99] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:50:59.943 INFO 9 --- [ocp-schedules-14,ade3276949b3efbf,0dc5195508d92e99] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:50:59.946 INFO 9 --- [ocp-schedules-26,8dfb0fc1a60c8d59,815d72a7a000c949] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:59.946 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:50:59.946 INFO 9 --- [ocp-schedules-18,a3af16f43ee2feae,05b7719bffaefe64] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:59.946 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:50:59.946 INFO 9 --- [ocp-schedules-8,3cc51dae4b19d3e7,fde9e1f8d948831f] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:50:59.946 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:50:59.946 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:50:59.946 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:50:59.946 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:50:59.946 INFO 9 --- [host-check-clockdiff1,3cc51dae4b19d3e7,9c4929ae91479b86] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:50:59.946 INFO 9 --- [host-check-agent-status1,a3af16f43ee2feae,3259ccd603beccd0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:50:59.946 INFO 9 --- [host-check-clockdiff2,3cc51dae4b19d3e7,3d2d9b15c1e17d97] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:50:59.946 INFO 9 --- [host-check-agent-status2,a3af16f43ee2feae,5d32282265cfcac8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:50:59.946 INFO 9 --- [host-check-clockdiff3,3cc51dae4b19d3e7,df2a5ac2ed391e05] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:50:59.947 INFO 9 --- [host-check-agent-status3,a3af16f43ee2feae,5bd03641a8a5a067] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:50:59.947 INFO 9 --- [host-check-clockdiff4,3cc51dae4b19d3e7,14a837815866d37d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:50:59.947 INFO 9 --- [host-check-agent-status4,a3af16f43ee2feae,a0342be3a10ae0f7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:50:59.947 INFO 9 --- [host-check-clockdiff5,3cc51dae4b19d3e7,334b08cf5e0dfc05] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:50:59.947 INFO 9 --- [host-check-agent-status5,a3af16f43ee2feae,9a5eee69404b0e4f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:50:59.947 INFO 9 --- [host-check-clockdiff6,3cc51dae4b19d3e7,1684d869ae5ee636] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:50:59.947 INFO 9 --- [host-check-agent-status6,a3af16f43ee2feae,11840e71e5dace62] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:50:59.947 INFO 9 --- [ocp-schedules-16,d8571699010acbc7,9c499d4cd161cb11] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:50:59.955 INFO 9 --- [host-check-clockdiff6,3cc51dae4b19d3e7,1684d869ae5ee636] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001859 -1 -1 , error= 2025-09-16 13:50:59.955 INFO 9 --- [host-check-clockdiff3,3cc51dae4b19d3e7,df2a5ac2ed391e05] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001859 -1 -1 , error= 2025-09-16 13:50:59.955 INFO 9 --- [host-check-clockdiff1,3cc51dae4b19d3e7,9c4929ae91479b86] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001859 -1 -1 , error= 2025-09-16 13:50:59.955 INFO 9 --- [host-check-agent-status1,a3af16f43ee2feae,3259ccd603beccd0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:59.955 INFO 9 --- [host-check-clockdiff2,3cc51dae4b19d3e7,3d2d9b15c1e17d97] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001859 -2 -2 , error= 2025-09-16 13:50:59.955 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:59.955 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:59.957 INFO 9 --- [host-check-agent-status2,a3af16f43ee2feae,5d32282265cfcac8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:59.957 INFO 9 --- [host-check-agent-status3,a3af16f43ee2feae,5bd03641a8a5a067] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:59.957 INFO 9 --- [host-check-clockdiff4,3cc51dae4b19d3e7,14a837815866d37d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001859 -1 -1 , error= 2025-09-16 13:50:59.959 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:59.959 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:59.959 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:59.959 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:59.959 INFO 9 --- [host-check-clockdiff5,3cc51dae4b19d3e7,334b08cf5e0dfc05] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001859 -1 -1 , error= 2025-09-16 13:50:59.959 INFO 9 --- [host-check-agent-status6,a3af16f43ee2feae,11840e71e5dace62] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:59.959 INFO 9 --- [host-check-agent-status3,a3af16f43ee2feae,5bd03641a8a5a067] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:59.959 INFO 9 --- [host-check-agent-status5,a3af16f43ee2feae,9a5eee69404b0e4f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:59.959 INFO 9 --- [host-check-agent-status2,a3af16f43ee2feae,5d32282265cfcac8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:59.959 INFO 9 --- [host-check-agent-status1,a3af16f43ee2feae,3259ccd603beccd0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:59.960 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:59.960 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:59.960 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:59.960 INFO 9 --- [host-check-agent-status4,a3af16f43ee2feae,a0342be3a10ae0f7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:59.960 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:50:59.960 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:59.960 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:59.960 INFO 9 --- [host-check-agent-status6,a3af16f43ee2feae,11840e71e5dace62] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:59.960 INFO 9 --- [host-check-agent-status5,a3af16f43ee2feae,9a5eee69404b0e4f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:50:59.961 INFO 9 --- [host-check-agent-status4,a3af16f43ee2feae,a0342be3a10ae0f7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:59.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:59.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:50:59.977 INFO 9 --- [host-check-agent-status1,a3af16f43ee2feae,3259ccd603beccd0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:50:59.977 INFO 9 --- [host-check-agent-status2,a3af16f43ee2feae,5d32282265cfcac8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:50:59.977 INFO 9 --- [host-check-agent-status6,a3af16f43ee2feae,11840e71e5dace62] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:50:59.977 INFO 9 --- [host-check-agent-status4,a3af16f43ee2feae,a0342be3a10ae0f7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:50:59.977 INFO 9 --- [host-check-agent-status3,a3af16f43ee2feae,5bd03641a8a5a067] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:50:59.977 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:50:59.977 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:50:59.977 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:50:59.978 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:50:59.978 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:50:59.978 INFO 9 --- [host-check-agent-status5,a3af16f43ee2feae,9a5eee69404b0e4f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:50:59.978 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:50:59.979 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:50:59.977906777+08:00 2025-09-16 13:50:59.979 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:50:59.979+08:00 2025-09-16 13:50:59.979 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:50:59.978136875+08:00 2025-09-16 13:50:59.979 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:50:59.978606561+08:00 2025-09-16 13:50:59.979 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:50:59.978283620+08:00 2025-09-16 13:50:59.980 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:50:59.979+08:00 2025-09-16 13:50:59.980 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:50:59.979+08:00 2025-09-16 13:50:59.980 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:50:59.979+08:00 2025-09-16 13:50:59.980 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:50:59.979239759+08:00 2025-09-16 13:50:59.980 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:50:59.979183271+08:00 2025-09-16 13:50:59.981 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:50:59.980+08:00 2025-09-16 13:50:59.981 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:50:59.979+08:00 and status AVAILABLE 2025-09-16 13:50:59.981 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:50:59.980+08:00 2025-09-16 13:50:59.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:50:59.981 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:50:59.979+08:00 and status AVAILABLE 2025-09-16 13:50:59.981 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:50:59.979+08:00 and status AVAILABLE 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status3,a3af16f43ee2feae,5bd03641a8a5a067] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status3,a3af16f43ee2feae,5bd03641a8a5a067] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status3,a3af16f43ee2feae,5bd03641a8a5a067] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:50:59.981 INFO 9 --- [ocp-schedules-23,70caab2c1bbd5769,31640a60e5261d8f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status2,a3af16f43ee2feae,5d32282265cfcac8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status4,a3af16f43ee2feae,a0342be3a10ae0f7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status2,a3af16f43ee2feae,5d32282265cfcac8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status4,a3af16f43ee2feae,a0342be3a10ae0f7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status2,a3af16f43ee2feae,5d32282265cfcac8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status4,a3af16f43ee2feae,a0342be3a10ae0f7] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status6,a3af16f43ee2feae,11840e71e5dace62] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status6,a3af16f43ee2feae,11840e71e5dace62] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status6,a3af16f43ee2feae,11840e71e5dace62] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status1,a3af16f43ee2feae,3259ccd603beccd0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status1,a3af16f43ee2feae,3259ccd603beccd0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:50:59.981 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:50:59.979+08:00 and status AVAILABLE 2025-09-16 13:50:59.981 INFO 9 --- [host-check-agent-status1,a3af16f43ee2feae,3259ccd603beccd0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:50:59.982 INFO 9 --- [host-check-agent-status5,a3af16f43ee2feae,9a5eee69404b0e4f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:50:59.982 INFO 9 --- [host-check-agent-status5,a3af16f43ee2feae,9a5eee69404b0e4f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:50:59.982 INFO 9 --- [host-check-agent-status5,a3af16f43ee2feae,9a5eee69404b0e4f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:50:59.982 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:50:59.980+08:00 and status AVAILABLE 2025-09-16 13:50:59.982 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:50:59.980+08:00 and status AVAILABLE 2025-09-16 13:50:59.984 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:50:59.986 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:50:59.986 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:50:59.986 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:50:59.986 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:50:59.986 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:50:59.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:50:59.990 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:50:59.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:50:59.991 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:50:59.991 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:50:59.991 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:50:59.991 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:50:59.991 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:50:59.992 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:50:59.992 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:50:59.992 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:50:59.992 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:50:59.992 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:50:59.993 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:00.004 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:51:00.003199+08:00, lastProcessTime=2025-09-16T13:50:50.003039+08:00 2025-09-16 13:51:00.005 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:00.006 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:00.006 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:00.006 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:00.006 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:00.030 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:00.032 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:00.032 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:51:00.033 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:51:00.033 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:51:00.033 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:51:00.034 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:51:00.034 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:51:00.039 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:51:00.041 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:51:00.041 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:51:00.041 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:51:00.042 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:51:00.042 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:51:00.046 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:51:00.055 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:00.056 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:00.056 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:00.057 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:00.057 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:00.057 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:00.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:00.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:00.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:51:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:00.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:51:00.075 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:00.084 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:51:00.085 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:51:00.085 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:51:00.085 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:51:00.085 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:51:00.085 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:51:00.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:00.091 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:51:00.091 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:51:00.092 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:51:00.092 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:51:00.092 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:51:00.093 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:51:00.104 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:00.105 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:00.105 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:00.105 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:00.105 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:00.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:00.107 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:00.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:00.129 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:51:00.003199+08:00 2025-09-16 13:51:00.132 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:51:00.132 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:51:00.133 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:51:00.134 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:51:00.134 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:51:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:00.139 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:51:00.139 INFO 9 --- [host-check-host-status2,8dfb0fc1a60c8d59,3d419e878fcc76e1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:51:00.139 INFO 9 --- [host-check-host-status3,8dfb0fc1a60c8d59,6bef5d280d50f439] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:51:00.140 INFO 9 --- [host-check-host-status1,8dfb0fc1a60c8d59,f50a71a37566b4cf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:51:00.140 INFO 9 --- [host-check-host-status6,8dfb0fc1a60c8d59,136d103dfcff9c05] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:51:00.141 INFO 9 --- [host-check-host-status4,8dfb0fc1a60c8d59,edf3fff76190f5ff] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:51:00.145 INFO 9 --- [host-check-host-status5,8dfb0fc1a60c8d59,aca244610934c4d5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:51:00.150 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.150 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:00.166 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.166 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:00.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:00.181 INFO 9 --- [ocp-async-8,b085d8ebdd70ad89,8cce84c1ed5ad4d9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:51:00.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:00.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:00.223 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:00.237 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:00.238 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:00.239 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:51:00.245 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:51:00.248 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:51:00.250 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:00.251 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:00.265 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:51:00.326 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:51:00.340 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:00.341 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:00.342 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:51:00.357 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:51:00.357 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:51:00.358 INFO 9 --- [ocp-schedules-27,fe4c01f22f036977,7d5a9fd67750c84b] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:51:00.465 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:00.465 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:00.525 INFO 9 --- [ocp-schedules-17,8fe94387ddaaf615,426d0d49df5234e1] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:51:00.532 WARN 9 --- [scanner-1369880-1,8fe94387ddaaf615,bc4bcc2412914fa0] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:51:00.543 INFO 9 --- [alarm-detect-6,8fe94387ddaaf615,b5855de364c5a939] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:51:00.543 INFO 9 --- [alarm-detect-20,8fe94387ddaaf615,ee15887702c8df81] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:51:00.543 INFO 9 --- [alarm-detect-8,8fe94387ddaaf615,a1920d0ba2758d00] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:51:00.557 INFO 9 --- [alarm-detect-18,8fe94387ddaaf615,1771c46ec6c28b5a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:51:00.779 WARN 9 --- [ocp-async-2,91a3943bfd76e700,fb1e5d102c7927df] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:00.779 INFO 9 --- [ocp-async-1,41eb61663627903b,7e12e580e1906fed] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:00.831 INFO 9 --- [ocp-schedules-16,b06a4711186b8a70,56104eda94c7f50a] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:51:01.636 INFO 9 --- [prometheus-minute-schedule-1,bea6e9839d333879,9a99cb812e60ba40] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:01.639 INFO 9 --- [prometheus-minute-schedule-1,bea6e9839d333879,9a99cb812e60ba40] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:02.779 WARN 9 --- [ocp-async-8,74f3b3863ee53b8c,b3d98afae0505caa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:02.779 INFO 9 --- [ocp-async-8,5f4eb45856e52318,4fb608322d3a2acd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:03.465 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:03.466 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:04.636 INFO 9 --- [prometheus-minute-schedule-1,7a87ea5a6d0632a0,f528e3ed45778708] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:04.639 INFO 9 --- [prometheus-minute-schedule-1,7a87ea5a6d0632a0,f528e3ed45778708] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:04.699 INFO 9 --- [ocp-schedules-10,cc1169bfb894b315,15dc9d8f34592f26] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:51:04.780 WARN 9 --- [ocp-async-7,bd3414b3fa4ba5a3,217e1c6f93ce05b9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:04.780 INFO 9 --- [ocp-async-3,2debb0959d6f7c7a,ad60ee6f71436793] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:06.466 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:06.467 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:06.780 WARN 9 --- [ocp-async-5,84a61414ac0cb342,62f52ac6e3f203ca] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:06.780 INFO 9 --- [ocp-async-5,5fb5bacc08bbc821,757ea23c1d36f295] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:07.636 INFO 9 --- [prometheus-minute-schedule-1,ff23abbc1e2d2a25,52e17f6fa64ab0be] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:07.639 INFO 9 --- [prometheus-minute-schedule-1,ff23abbc1e2d2a25,52e17f6fa64ab0be] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:08.780 WARN 9 --- [ocp-async-1,dfaaefb79d90b09f,0baa65498fec08df] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:08.780 INFO 9 --- [ocp-async-6,c92af4eb76bcd0b1,76ee9cba9909b776] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:08.920 INFO 9 --- [ocp-schedules-10,63200f1abfa8fb0c,d25156be78dc0ce4] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:51:08.922 INFO 9 --- [ocp-schedules-10,63200f1abfa8fb0c,d25156be78dc0ce4] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:51:09.467 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:09.468 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:10.002 INFO 9 --- [ocp-schedules-16,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:51:10.003 INFO 9 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:51:10.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:51:10.004335+08:00, lastProcessTime=2025-09-16T13:51:00.003199+08:00 2025-09-16 13:51:10.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:51:10.004335+08:00 2025-09-16 13:51:10.181 INFO 9 --- [ocp-async-4,2564399e9348729e,fe8d040cee2e628a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:51:10.296 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:51:10.559 INFO 9 --- [ocp-schedules-10,125458253d721547,3affb36af9dd43de] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:51:10.564 WARN 9 --- [scanner-1370049-1,125458253d721547,caab6053e790e930] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:51:10.636 INFO 9 --- [prometheus-minute-schedule-1,faae60cebce277fd,76c7e61650cb198c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:10.639 INFO 9 --- [prometheus-minute-schedule-1,faae60cebce277fd,76c7e61650cb198c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:10.780 WARN 9 --- [ocp-async-7,766036b43e7cee00,20cda21176db0589] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:10.780 INFO 9 --- [ocp-async-7,a864fa229c0069ca,2d3c7b8e27000965] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:11.718 INFO 9 --- [metric-archive-async-3,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001800, nodeCount=40, affectRows=40 2025-09-16 13:51:11.729 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001800, nodeCount=423, affectRows=423 2025-09-16 13:51:12.468 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:12.469 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:12.780 WARN 9 --- [ocp-async-4,887e1f2a188d60e9,fff98fa754b9c538] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:12.780 INFO 9 --- [ocp-async-2,5b3b5c0001be6db3,f923c3d0e3a21ebd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:13.636 INFO 9 --- [prometheus-minute-schedule-1,e6ade2d6f7e1e2b5,9b1e3011808dd15a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:13.639 INFO 9 --- [prometheus-minute-schedule-1,e6ade2d6f7e1e2b5,9b1e3011808dd15a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:14.515 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001800, nodeCount=1000, affectRows=1000 2025-09-16 13:51:14.517 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001800, nodeCount=1000, validCount=996 2025-09-16 13:51:14.565 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001800, nodeCount=1000, affectRows=1000 2025-09-16 13:51:14.567 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001800, nodeCount=1000, validCount=998 2025-09-16 13:51:14.578 INFO 9 --- [ocp-schedules-17,955a11d13fd2c7ff,46e7616b226b3ab9] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:51:14.579 ERROR 9 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221684167) Duplicate entry '824147022748467200-1758001740' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221684167) Duplicate entry '824147022748467200-1758001740' for key 'PRIMARY' 2025-09-16 13:51:14.583 INFO 9 --- [ocp-schedules-17,955a11d13fd2c7ff,46e7616b226b3ab9] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:51:14.583 INFO 9 --- [ocp-schedules-17,955a11d13fd2c7ff,46e7616b226b3ab9] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:51:14.702 INFO 9 --- [ocp-schedules-23,8314fe0a773adae8,3daac0f7fae58395] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:51:14.780 WARN 9 --- [ocp-async-1,f935728577473349,cd22cecea5117711] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:14.780 INFO 9 --- [ocp-async-10,aeb6171094d17efb,fda81f9d57af4434] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:15.454 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001800, nodeCount=416, affectRows=416 2025-09-16 13:51:15.455 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001800, nodeCount=416, validCount=416 2025-09-16 13:51:15.455 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001800, nodeCount=437, affectRows=437 2025-09-16 13:51:15.456 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001800, nodeCount=437, validCount=435 2025-09-16 13:51:15.469 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:15.470 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:15.631 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,6ac2e0b991eecfb1,5f1b11ae12002d79] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=6ac2e0b991eecfb1, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:51:15.631 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,6ac2e0b991eecfb1,5f1b11ae12002d79] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=6ac2e0b991eecfb1, duration=1 ms] 2025-09-16 13:51:15.893 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001800, nodeCount=1000, affectRows=1000 2025-09-16 13:51:15.895 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001800, nodeCount=992, validCount=946 2025-09-16 13:51:16.636 INFO 9 --- [prometheus-minute-schedule-1,0719859dbe1ed324,2bdf831cc2e31940] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:16.639 INFO 9 --- [prometheus-minute-schedule-1,0719859dbe1ed324,2bdf831cc2e31940] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:16.780 WARN 9 --- [ocp-async-8,232e8e66550a3044,feb85a19ed65f3ab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:16.780 INFO 9 --- [ocp-async-3,4aa655125aa2525b,3e64243b64b05129] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:18.470 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:18.471 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:18.780 WARN 9 --- [ocp-async-7,0ae098f51d1a531d,e4b5f252a4f937b2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:18.780 INFO 9 --- [ocp-async-4,e62136553cea1581,89beeb0ec7e07222] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:18.927 INFO 9 --- [ocp-schedules-24,c47f35c90295958b,ccf844abc6959f33] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:51:18.929 INFO 9 --- [ocp-schedules-24,c47f35c90295958b,ccf844abc6959f33] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:51:19.636 INFO 9 --- [prometheus-minute-schedule-1,e153ae79ddeef438,c3236363977151f1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:19.639 INFO 9 --- [prometheus-minute-schedule-1,e153ae79ddeef438,c3236363977151f1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:51:20.003222+08:00, lastProcessTime=2025-09-16T13:51:10.004335+08:00 2025-09-16 13:51:20.127 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:51:20.003222+08:00 2025-09-16 13:51:20.181 INFO 9 --- [ocp-async-8,5b3b2641582f7b8e,503d85b041fd22b7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:51:20.586 INFO 9 --- [ocp-schedules-18,f2fb726f4f64182b,a85e911fe9a7ad40] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:51:20.590 WARN 9 --- [scanner-1371043-1,f2fb726f4f64182b,9837c608e12557bb] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:51:20.601 INFO 9 --- [alarm-detect-17,f2fb726f4f64182b,a8756f0e9ddb8422] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:51:20.603 INFO 9 --- [alarm-detect-19,f2fb726f4f64182b,0a1bf48d47a4e043] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:51:20.603 INFO 9 --- [alarm-detect-3,f2fb726f4f64182b,67f2ecea0cb8bdf8] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:51:20.616 INFO 9 --- [alarm-detect-16,f2fb726f4f64182b,dfd48e50592d266e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:51:20.636 INFO 9 --- [prometheus-cache-monitor1,dd093660cfb736ca,0f064330dd3c2276] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:51:20.636 INFO 9 --- [prometheus-cache-monitor1,dd093660cfb736ca,0f064330dd3c2276] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:51:20.781 WARN 9 --- [ocp-async-6,9a00a39c8dca7bea,abbdf48b4a4361f5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:20.781 INFO 9 --- [ocp-async-1,8ed5aa029406b8d6,71c7533c7177c7cc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:21.471 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:21.471 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:22.636 INFO 9 --- [prometheus-minute-schedule-1,2397360cd3fa8855,166e79dccfc3695d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:22.641 INFO 9 --- [prometheus-minute-schedule-1,2397360cd3fa8855,166e79dccfc3695d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:22.781 WARN 9 --- [ocp-async-8,b94865bb9f796ca9,eb3eeeb81eb6a57d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:22.781 INFO 9 --- [ocp-async-9,8547389e0d44e435,096e2bb17b4c54bc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:24.471 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:24.472 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:24.705 INFO 9 --- [ocp-schedules-1,40bdc60ad6894bdc,3766796ef30a53f1] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:51:24.781 WARN 9 --- [ocp-async-7,55ee12e457878c47,b39b8e650a9b0921] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:24.781 INFO 9 --- [ocp-async-5,ee3cac4a32f52882,a443c61ead1c9d16] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:25.636 INFO 9 --- [prometheus-minute-schedule-1,8f2e5527a924fd82,ee422350f526268a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:25.639 INFO 9 --- [prometheus-minute-schedule-1,8f2e5527a924fd82,ee422350f526268a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:26.781 WARN 9 --- [ocp-async-2,6e1399a513cc8965,803f4216d0dcd88f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:26.781 INFO 9 --- [ocp-async-10,a0a2960885779b7f,fd551b5c128d764b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:27.472 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:27.473 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:28.636 INFO 9 --- [prometheus-minute-schedule-1,cc9a0ba52ce67f7a,00f89d676f8c49d3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:28.639 INFO 9 --- [prometheus-minute-schedule-1,cc9a0ba52ce67f7a,00f89d676f8c49d3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:28.781 WARN 9 --- [ocp-async-1,141d6fd36a9850ed,a26b8cfe42a1c272] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:28.781 INFO 9 --- [ocp-async-8,dd42b8a2e2b75cd0,ab3694dae958844f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:28.934 INFO 9 --- [ocp-schedules-29,0c8d784af3a6e79c,312a9bb742349805] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:51:28.936 INFO 9 --- [ocp-schedules-29,0c8d784af3a6e79c,312a9bb742349805] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:51:29.938 INFO 9 --- [ocp-schedules-23,71cccd73b60f1116,00b9e8641ef5fa7c] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:51:29.941 INFO 9 --- [ocp-schedules-14,b75368e4e04c275e,bca643095626c38a] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:51:29.941 INFO 9 --- [ocp-schedules-16,a9eadd337269a2fe,fb3ce4a67048490e] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:51:29.942 INFO 9 --- [ocp-schedules-15,de4dd2662d41e9a2,2bc35e182e3a2b7f] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:51:29.942 INFO 9 --- [ocp-schedules-14,b75368e4e04c275e,bca643095626c38a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:29.943 INFO 9 --- [ocp-schedules-16,a9eadd337269a2fe,fb3ce4a67048490e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:29.943 INFO 9 --- [ocp-schedules-15,de4dd2662d41e9a2,2bc35e182e3a2b7f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:29.944 INFO 9 --- [ocp-schedules-15,de4dd2662d41e9a2,2bc35e182e3a2b7f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:51:29.946 INFO 9 --- [ocp-schedules-20,303df7db3c5dd772,686ecb6cb366a130] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:51:29.946 INFO 9 --- [ocp-schedules-27,211373e7981747b7,668853b90597bd80] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:51:29.946 INFO 9 --- [ocp-schedules-30,d2cc8edd2a887fa3,836048fc78ac2f99] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:51:29.946 INFO 9 --- [host-check-clockdiff1,303df7db3c5dd772,0bc80ed26cb4a68f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:51:29.946 INFO 9 --- [host-check-clockdiff2,303df7db3c5dd772,584d20834f6770f3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:51:29.946 INFO 9 --- [host-check-clockdiff3,303df7db3c5dd772,ab9c81fcb3c30ee7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:51:29.946 INFO 9 --- [host-check-clockdiff4,303df7db3c5dd772,2bbe037c687d8c1a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:51:29.946 INFO 9 --- [host-check-clockdiff5,303df7db3c5dd772,81dd248235b7cadf] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:51:29.946 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:51:29.946 INFO 9 --- [host-check-agent-status1,d2cc8edd2a887fa3,3bfd2dcf0f11766d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:51:29.946 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:51:29.946 INFO 9 --- [host-check-clockdiff6,303df7db3c5dd772,60231a8a45322d5d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:51:29.946 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:51:29.946 INFO 9 --- [host-check-agent-status2,d2cc8edd2a887fa3,f95ebcb54e23efc5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:51:29.946 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:51:29.946 INFO 9 --- [host-check-agent-status3,d2cc8edd2a887fa3,cae27a6678fc6810] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:51:29.947 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:51:29.947 INFO 9 --- [host-check-agent-status4,d2cc8edd2a887fa3,e616825b5e63e7dc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:51:29.947 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:51:29.947 INFO 9 --- [host-check-agent-status5,d2cc8edd2a887fa3,bd3d4423073591ea] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:51:29.947 INFO 9 --- [host-check-agent-status6,d2cc8edd2a887fa3,e57bae1f1016b68b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:51:29.957 INFO 9 --- [ocp-schedules-13,9cd27e76af8a21eb,ab435445fa3838b3] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:51:29.958 INFO 9 --- [host-check-clockdiff1,303df7db3c5dd772,0bc80ed26cb4a68f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001889 -1 -1 , error= 2025-09-16 13:51:29.959 INFO 9 --- [host-check-clockdiff3,303df7db3c5dd772,ab9c81fcb3c30ee7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001889 -1 -1 , error= 2025-09-16 13:51:29.959 INFO 9 --- [host-check-clockdiff6,303df7db3c5dd772,60231a8a45322d5d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001889 -1 -1 , error= 2025-09-16 13:51:29.960 INFO 9 --- [host-check-clockdiff4,303df7db3c5dd772,2bbe037c687d8c1a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001889 -1 -1 , error= 2025-09-16 13:51:29.960 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:51:29.960 INFO 9 --- [host-check-agent-status1,d2cc8edd2a887fa3,3bfd2dcf0f11766d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:51:29.960 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:51:29.961 INFO 9 --- [host-check-agent-status3,d2cc8edd2a887fa3,cae27a6678fc6810] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:51:29.961 INFO 9 --- [host-check-agent-status2,d2cc8edd2a887fa3,f95ebcb54e23efc5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:51:29.961 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:51:29.961 INFO 9 --- [host-check-agent-status6,d2cc8edd2a887fa3,e57bae1f1016b68b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:29.961 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:51:29.961 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:51:29.961 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:51:29.962 INFO 9 --- [host-check-agent-status1,d2cc8edd2a887fa3,3bfd2dcf0f11766d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:51:29.962 INFO 9 --- [host-check-agent-status3,d2cc8edd2a887fa3,cae27a6678fc6810] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:51:29.962 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:51:29.962 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:29.962 INFO 9 --- [host-check-agent-status2,d2cc8edd2a887fa3,f95ebcb54e23efc5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:51:29.962 INFO 9 --- [host-check-agent-status6,d2cc8edd2a887fa3,e57bae1f1016b68b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:29.962 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:51:29.962 INFO 9 --- [host-check-agent-status4,d2cc8edd2a887fa3,e616825b5e63e7dc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:51:29.962 INFO 9 --- [ocp-schedules-9,6d6801d568ac2dc0,3e7e880e886b0859] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:51:29.963 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:29.963 INFO 9 --- [host-check-agent-status4,d2cc8edd2a887fa3,e616825b5e63e7dc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:51:29.963 INFO 9 --- [ocp-schedules-29,5eeb75e99ce036f8,6956a23e5513cc95] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:51:29.963 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:51:29.963 INFO 9 --- [host-check-agent-status5,d2cc8edd2a887fa3,bd3d4423073591ea] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:51:29.964 INFO 9 --- [host-check-agent-status5,d2cc8edd2a887fa3,bd3d4423073591ea] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:29.965 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:29.967 INFO 9 --- [ocp-schedules-9,6d6801d568ac2dc0,3e7e880e886b0859] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:51:29.970 INFO 9 --- [ocp-schedules-29,5eeb75e99ce036f8,6956a23e5513cc95] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:51:29.976 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:51:29.976 INFO 9 --- [host-check-agent-status3,d2cc8edd2a887fa3,cae27a6678fc6810] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:51:29.976 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:51:29.976 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:51:29.977 INFO 9 --- [host-check-agent-status1,d2cc8edd2a887fa3,3bfd2dcf0f11766d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:51:29.977 INFO 9 --- [host-check-agent-status2,d2cc8edd2a887fa3,f95ebcb54e23efc5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:51:29.977 INFO 9 --- [host-check-agent-status6,d2cc8edd2a887fa3,e57bae1f1016b68b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:51:29.977 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:51:29.978 INFO 9 --- [host-check-agent-status4,d2cc8edd2a887fa3,e616825b5e63e7dc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:51:29.978 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:51:29.977624217+08:00 2025-09-16 13:51:29.978 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:51:29.977692287+08:00 2025-09-16 13:51:29.978 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:51:29.977072848+08:00 2025-09-16 13:51:29.979 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:51:29.978+08:00 2025-09-16 13:51:29.979 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:51:29.978+08:00 2025-09-16 13:51:29.979 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:51:29.978+08:00 2025-09-16 13:51:29.979 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:51:29.978077649+08:00 2025-09-16 13:51:29.979 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:51:29.979 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:29.980 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:51:29.979+08:00 2025-09-16 13:51:29.980 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:51:29.981 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:51:29.978+08:00 and status AVAILABLE 2025-09-16 13:51:29.981 INFO 9 --- [host-check-agent-status5,d2cc8edd2a887fa3,bd3d4423073591ea] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:51:29.981 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:51:29.978+08:00 and status AVAILABLE 2025-09-16 13:51:29.981 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:51:29.978+08:00 and status AVAILABLE 2025-09-16 13:51:29.981 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:51:29.979954318+08:00 2025-09-16 13:51:29.981 INFO 9 --- [host-check-agent-status3,d2cc8edd2a887fa3,cae27a6678fc6810] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:51:29.981 INFO 9 --- [host-check-agent-status3,d2cc8edd2a887fa3,cae27a6678fc6810] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:51:29.981 INFO 9 --- [host-check-agent-status3,d2cc8edd2a887fa3,cae27a6678fc6810] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:51:29.981 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:51:29.979+08:00 and status AVAILABLE 2025-09-16 13:51:29.981 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:51:29.981+08:00 2025-09-16 13:51:29.981 INFO 9 --- [host-check-agent-status1,d2cc8edd2a887fa3,3bfd2dcf0f11766d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:51:29.981 INFO 9 --- [host-check-agent-status1,d2cc8edd2a887fa3,3bfd2dcf0f11766d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status1,d2cc8edd2a887fa3,3bfd2dcf0f11766d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status2,d2cc8edd2a887fa3,f95ebcb54e23efc5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status2,d2cc8edd2a887fa3,f95ebcb54e23efc5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status2,d2cc8edd2a887fa3,f95ebcb54e23efc5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:51:29.982 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status6,d2cc8edd2a887fa3,e57bae1f1016b68b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status6,d2cc8edd2a887fa3,e57bae1f1016b68b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status6,d2cc8edd2a887fa3,e57bae1f1016b68b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status4,d2cc8edd2a887fa3,e616825b5e63e7dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status4,d2cc8edd2a887fa3,e616825b5e63e7dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:51:29.982 INFO 9 --- [host-check-agent-status4,d2cc8edd2a887fa3,e616825b5e63e7dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:51:29.983 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:51:29.981855629+08:00 2025-09-16 13:51:29.983 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:51:29.981+08:00 and status AVAILABLE 2025-09-16 13:51:29.983 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:51:29.983+08:00 2025-09-16 13:51:29.983 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:51:29.984 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:51:29.984 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:51:29.984 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:51:29.985 INFO 9 --- [host-check-agent-status5,d2cc8edd2a887fa3,bd3d4423073591ea] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:51:29.985 INFO 9 --- [host-check-agent-status5,d2cc8edd2a887fa3,bd3d4423073591ea] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:51:29.985 INFO 9 --- [host-check-agent-status5,d2cc8edd2a887fa3,bd3d4423073591ea] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:51:29.985 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:51:29.983+08:00 and status AVAILABLE 2025-09-16 13:51:29.985 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:51:29.985 INFO 9 --- [ocp-schedules-16,a9eadd337269a2fe,fb3ce4a67048490e] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:51:29.986 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:51:29.987 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:51:29.989 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:51:29.989 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:51:29.990 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:51:29.990 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:51:29.990 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:51:29.990 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:51:29.991 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:51:29.991 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:51:29.992 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:29.992 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:51:29.992 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:29.993 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:29.994 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:29.994 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:51:30.004 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:30.005 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:30.005 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:30.005 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:51:30.004150+08:00, lastProcessTime=2025-09-16T13:51:20.003222+08:00 2025-09-16 13:51:30.006 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:30.007 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:51:30.032 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:51:30.032 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:51:30.033 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:51:30.033 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:51:30.034 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:51:30.034 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:51:30.038 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:30.038 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:51:30.039 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:51:30.039 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:51:30.039 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:30.040 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:51:30.040 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:51:30.040 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:51:30.042 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:51:30.050 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:30.051 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:30.052 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:30.052 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:30.052 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:30.054 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:51:30.075 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:30.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:30.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:51:30.078 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:51:30.080 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:51:30.080 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:51:30.080 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:51:30.080 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:51:30.081 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:30.082 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:51:30.083 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:51:30.084 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:30.085 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:51:30.086 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:51:30.086 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:51:30.087 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:51:30.087 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:51:30.088 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:51:30.097 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:30.097 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:30.097 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:30.099 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:30.099 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.099 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:30.099 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:30.100 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:51:30.101 INFO 9 --- [prometheus-second-schedule-1,2b4fee32b6f4c87c,e611ea4b4e788ed5] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:51:30.116 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.116 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:30.124 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:51:30.125 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:51:30.126 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:51:30.129 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:51:30.129 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:51:30.130 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:51:30.130 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.130 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:30.131 INFO 9 --- [host-check-host-status2,211373e7981747b7,cdef19013171d5d8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:51:30.131 INFO 9 --- [host-check-host-status1,211373e7981747b7,4a95350c91fcc1bd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:51:30.133 INFO 9 --- [host-check-host-status4,211373e7981747b7,58f2bb5c8390764b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:51:30.136 INFO 9 --- [host-check-host-status5,211373e7981747b7,b6864d5115938dd3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:51:30.136 INFO 9 --- [host-check-host-status6,211373e7981747b7,48456f6d2e0c8a95] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:51:30.136 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:51:30.004150+08:00 2025-09-16 13:51:30.136 INFO 9 --- [host-check-host-status3,211373e7981747b7,7b9b185777951775] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:51:30.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:30.161 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.161 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:30.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:30.181 INFO 9 --- [ocp-async-10,e9efbed772deaa85,b8c11f6fe6753d5c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:51:30.191 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.191 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:30.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:51:30.220 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.220 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:51:30.236 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:51:30.250 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:30.252 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:30.252 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:51:30.257 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:51:30.260 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:51:30.263 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:30.264 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:30.268 INFO 9 --- [ocp-schedules-22,8323e9f75f7547c4,70573997545a1bc1] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:51:30.269 INFO 9 --- [ocp-schedules-22,8323e9f75f7547c4,70573997545a1bc1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:30.270 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:51:30.270 INFO 9 --- [ocp-schedules-22,8323e9f75f7547c4,70573997545a1bc1] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:51:30.277 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:51:30.344 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:51:30.357 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:30.359 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:30.360 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:51:30.375 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:51:30.375 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:51:30.375 INFO 9 --- [ocp-schedules-14,b75368e4e04c275e,bca643095626c38a] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:51:30.396 INFO 9 --- [ocp-schedules-5,8a100276b981d3fb,9b84eb147e433bd7] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:51:30.473 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:30.474 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:30.572 INFO 9 --- [ocp-schedules-23,912a6876dcf48aec,147e537060d72547] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:51:30.574 INFO 9 --- [ocp-schedules-23,912a6876dcf48aec,147e537060d72547] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:51:30.574 INFO 9 --- [ocp-schedules-23,912a6876dcf48aec,147e537060d72547] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:51:30.619 INFO 9 --- [ocp-schedules-15,248182b403712c20,3e360e9432bae1cd] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:51:30.623 WARN 9 --- [scanner-1371208-1,248182b403712c20,ac3bb8ae9f307adf] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:51:30.781 WARN 9 --- [ocp-async-7,a6b5d58d341e966d,09cbcd6fbadfab18] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:30.781 INFO 9 --- [ocp-async-2,478c9e24bb5027ab,15d10d703c566254] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:30.834 INFO 9 --- [ocp-schedules-29,797fcf2e8cf3d875,a52335ebd2064a2c] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:51:30.967 INFO 9 --- [ocp-schedules-11,6314b9fa451ba522,efc9c58169817654] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:51:30.967 INFO 9 --- [ocp-schedules-11,6314b9fa451ba522,efc9c58169817654] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:51:31.459 INFO 9 --- [ocp-schedules-7,8a45bb72d16e7613,2dacf5dc0bbc91d3] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:51:31.459 INFO 9 --- [ocp-schedules-7,8a45bb72d16e7613,2dacf5dc0bbc91d3] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001891 2025-09-16 13:51:31.460 INFO 9 --- [ocp-schedules-7,8a45bb72d16e7613,2dacf5dc0bbc91d3] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:51:31.622 INFO 9 --- [ocp-schedules-8,56f933c3b0473211,fdcdb17149894c8c] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:51:31.636 INFO 9 --- [prometheus-minute-schedule-1,3d841223323386ce,47b47b27a8d27b4d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:31.639 INFO 9 --- [prometheus-minute-schedule-1,3d841223323386ce,47b47b27a8d27b4d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:31.676 INFO 9 --- [ocp-schedules-19,e90c350ae3642104,b010c206d706374c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:51:31.687 INFO 9 --- [ocp-schedules-14,4d69d53d2f28ac72,5b4798b4e6a9b557] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:51:31.687 INFO 9 --- [ocp-schedules-14,4d69d53d2f28ac72,5b4798b4e6a9b557] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:51:31.687 INFO 9 --- [ocp-schedules-14,4d69d53d2f28ac72,5b4798b4e6a9b557] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:51:31.687 INFO 9 --- [ocp-schedules-14,4d69d53d2f28ac72,5b4798b4e6a9b557] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:51:31.688 INFO 9 --- [ocp-schedules-14,4d69d53d2f28ac72,5b4798b4e6a9b557] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:51:31.688 INFO 9 --- [ocp-schedules-14,4d69d53d2f28ac72,5b4798b4e6a9b557] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:51:31.731 INFO 9 --- [host-check-clockdiff2,303df7db3c5dd772,584d20834f6770f3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001891 -2 -2 , error= 2025-09-16 13:51:31.731 INFO 9 --- [host-check-clockdiff5,303df7db3c5dd772,81dd248235b7cadf] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001891 -1 -1 , error= 2025-09-16 13:51:32.781 WARN 9 --- [ocp-async-10,ecaff5591875d4fb,994a9f56ef6b81d9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:32.781 INFO 9 --- [ocp-async-1,08f9ef71185185b9,b0572279ecc73354] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:33.379 INFO 9 --- [ocp-schedules-13,bcf08a2f4778671c,713f9f8450d00d0d] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:51:33.474 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:33.475 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:33.510 INFO 9 --- [ocp-schedules-30,2565e15afbb4c6f4,f6d237155e53fda7] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:51:33.510+08:00, clusters=[1] 2025-09-16 13:51:33.512 INFO 9 --- [ocp-schedules-30,2565e15afbb4c6f4,f6d237155e53fda7] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:51:34.070 INFO 9 --- [ocp-schedules-27,1a61a5fbcabc727d,aecc234a6a423f68] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:51:34.070 INFO 9 --- [ocp-schedules-27,1a61a5fbcabc727d,aecc234a6a423f68] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:51:34.070 INFO 9 --- [ocp-schedules-27,1a61a5fbcabc727d,aecc234a6a423f68] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:51:34.086 INFO 9 --- [ocp-schedules-27,1a61a5fbcabc727d,aecc234a6a423f68] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:51:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:51:34.584 INFO 9 --- [ocp-schedules-6,dfbe38733a5e6cd6,da3bb6307ecfbc9a] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:51:34.589 INFO 9 --- [ocp-schedules-6,dfbe38733a5e6cd6,da3bb6307ecfbc9a] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:51:34.589 INFO 9 --- [ocp-schedules-6,dfbe38733a5e6cd6,da3bb6307ecfbc9a] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:51:34.636 INFO 9 --- [prometheus-minute-schedule-1,0a2565fca3648d50,4786960be3a4d9a3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:34.639 INFO 9 --- [prometheus-minute-schedule-1,0a2565fca3648d50,4786960be3a4d9a3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:34.709 INFO 9 --- [ocp-schedules-3,6e79b0802b215b56,657d1288b8d55f4b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:51:34.781 WARN 9 --- [ocp-async-8,c84fd1d3847aca7c,4d20f90f064c589a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:34.781 INFO 9 --- [ocp-async-9,3b685bb944f9a67d,41a2f9079f584e62] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:35.550 INFO 9 --- [ocp-schedules-2,a96b61e22222a495,51e134f0c33f71e4] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:51:35.550+08:00, clusters=[1] 2025-09-16 13:51:35.554 INFO 9 --- [ocp-schedules-2,a96b61e22222a495,51e134f0c33f71e4] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:51:36.475 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:36.475 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:36.781 WARN 9 --- [ocp-async-5,a3525b3dcbbeeb24,c4b41b8c0dcef24d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:36.782 INFO 9 --- [ocp-async-6,248f38a8f0009ccd,8b63544894fc8733] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:37.636 INFO 9 --- [prometheus-minute-schedule-1,799a2ebb89e43703,58948b3aa5900135] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:37.639 INFO 9 --- [prometheus-minute-schedule-1,799a2ebb89e43703,58948b3aa5900135] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:37.699 INFO 9 --- [ocp-schedules-16,f2d41dbd9f1f8d09,0c25184505589b12] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:51:37.700 INFO 9 --- [ocp-schedules-16,f2d41dbd9f1f8d09,0c25184505589b12] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:37.720 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:37.721 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:51:37.734 INFO 9 --- [ocp-schedules-16,f2d41dbd9f1f8d09,0c25184505589b12] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:51:38.782 WARN 9 --- [ocp-async-2,05e9fc0b5e292162,a36a3583d50eea0b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:38.782 INFO 9 --- [ocp-async-10,ad774c3a987d13cd,2ae353ef2dbf95e7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:38.941 INFO 9 --- [ocp-schedules-10,0a1d42f1e2405389,fa273b64ac51b29a] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:51:38.943 INFO 9 --- [ocp-schedules-10,0a1d42f1e2405389,fa273b64ac51b29a] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:51:39.475 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:39.476 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:39.736 INFO 9 --- [ocp-schedules-23,a1fdbb1bb87cce82,6f4013f90fe379fe] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:51:39.736 INFO 9 --- [ocp-schedules-23,a1fdbb1bb87cce82,6f4013f90fe379fe] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:51:39.742 INFO 9 --- [ocp-schedules-20,5bc14759290ed6d4,8a31cce40bf0e6d7] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:51:39.742 INFO 9 --- [ocp-schedules-20,5bc14759290ed6d4,8a31cce40bf0e6d7] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:51:39.742 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:51:39.742 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:51:39.742 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:51:39.742 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:51:39.746 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:51:39.746 INFO 9 --- [ocp-schedules-20,5bc14759290ed6d4,8a31cce40bf0e6d7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:51:39.746 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:39.746 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:51:39.746 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:51:39.747 INFO 9 --- [ocp-schedules-20,5bc14759290ed6d4,8a31cce40bf0e6d7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:51:39.747 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:51:39.747 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:39.747 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:39.747 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:51:39.751 INFO 9 --- [Collect all tenants major compactions1,a1fdbb1bb87cce82,e422e34ebc02a6c3] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:51:39.751 INFO 9 --- [Collect all tenants major compactions2,a1fdbb1bb87cce82,101f5526694314d9] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:51:39.751 INFO 9 --- [Collect all tenants major compactions3,a1fdbb1bb87cce82,0aafcc98315904b5] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:51:39.761 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:51:39.761 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:51:39.761 INFO 9 --- [ocp-schedules-20,5bc14759290ed6d4,8a31cce40bf0e6d7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:51:39.761 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:51:39.761 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:51:39.764 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:51:39.767 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:51:39.768 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:51:39.770 INFO 9 --- [Collect all tenants major compactions2,a1fdbb1bb87cce82,101f5526694314d9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:39.770 INFO 9 --- [Collect all tenants major compactions3,a1fdbb1bb87cce82,0aafcc98315904b5] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:39.770 INFO 9 --- [Collect all tenants major compactions1,a1fdbb1bb87cce82,e422e34ebc02a6c3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:39.771 INFO 9 --- [Collect all tenants major compactions2,a1fdbb1bb87cce82,101f5526694314d9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:51:39.772 INFO 9 --- [Collect all tenants major compactions3,a1fdbb1bb87cce82,0aafcc98315904b5] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:51:39.772 INFO 9 --- [Collect all tenants major compactions1,a1fdbb1bb87cce82,e422e34ebc02a6c3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:51:39.775 INFO 9 --- [Collect all tenants major compactions2,a1fdbb1bb87cce82,101f5526694314d9] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:51:39.776 INFO 9 --- [Collect all tenants major compactions3,a1fdbb1bb87cce82,0aafcc98315904b5] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:51:39.776 INFO 9 --- [Collect all tenants major compactions1,a1fdbb1bb87cce82,e422e34ebc02a6c3] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:51:39.777 INFO 9 --- [ocp-schedules-23,a1fdbb1bb87cce82,6f4013f90fe379fe] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:51:39.782 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:51:39.785 INFO 9 --- [ocp-schedules-20,5bc14759290ed6d4,8a31cce40bf0e6d7] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:51:40.004 INFO 9 --- [ocp-schedules-8,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:51:40.004 INFO 9 --- [ocp-schedules-25,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:51:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:51:40.004387+08:00, lastProcessTime=2025-09-16T13:51:30.004150+08:00 2025-09-16 13:51:40.124 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:51:40.004387+08:00 2025-09-16 13:51:40.181 INFO 9 --- [ocp-async-5,a77ca3b8c166a02c,c7686efe30abb4e6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:51:40.636 INFO 9 --- [prometheus-minute-schedule-1,d4022f3d45fef49e,7d3c083edc85fc4c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:40.639 INFO 9 --- [prometheus-minute-schedule-1,d4022f3d45fef49e,7d3c083edc85fc4c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:40.646 INFO 9 --- [ocp-schedules-19,602e699b3b7ba866,2f23f8e9048a9e28] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:51:40.651 WARN 9 --- [scanner-1371333-1,602e699b3b7ba866,1431286c70a1f395] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:51:40.661 INFO 9 --- [alarm-detect-5,602e699b3b7ba866,5ce558a67c175ab1] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:51:40.662 INFO 9 --- [alarm-detect-8,602e699b3b7ba866,90c0afd04bb7342e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:51:40.663 INFO 9 --- [alarm-detect-17,602e699b3b7ba866,ddee00a0f0f5f359] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:51:40.675 INFO 9 --- [alarm-detect-14,602e699b3b7ba866,723bfa864f2db644] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:51:40.770 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:47:40.715, end=2025-09-16T13:49:40.768} 2025-09-16 13:51:40.775 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false 2025-09-16 13:51:40.775 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:51:40.778 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:47:40.715, end=2025-09-16T13:49:40.768},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:51:40.778 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:51:40.778 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:51:40.782 WARN 9 --- [ocp-async-4,32bba1640dc6336c,62671c61a5d7002a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:40.782 INFO 9 --- [ocp-async-4,20802ada31dd9d50,a578802b01961b84] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:40.841 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915500841000, endTimeUs=1758001780768000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:51:40.841Z, endTime=2025-09-16T05:49:40.768Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:51:40.851 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 36 2025-09-16 13:51:40.851 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:51:40.864 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:51:40.864 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001780768000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 13:51:40.872 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:51:40.872 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:51:40.885 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:51:40.886 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758001780768000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 13:51:40.892 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 13:51:40.919 INFO 9 --- [plan_change_detector4,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:51:40.841, end=2025-09-16T13:49:40.768}, clusterId=1, tenantId=3, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:51:40.919 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:51:40.922 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:47:40.715, end=2025-09-16T13:49:40.768},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:51:40.922 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:51:40.922 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:51:40.927 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:51:40.932 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 1 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:47:40.715, end=2025-09-16T13:49:40.768},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:51:40.941 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:51:40.941 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:51:40.948 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:51:42.172 INFO 9 --- [ocp-schedules-30,6d000eb07260aff1,f14c6a05fa8c2347] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:51:42.172 INFO 9 --- [ocp-schedules-30,6d000eb07260aff1,f14c6a05fa8c2347] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:51:42.209 INFO 9 --- [ocp-schedules-30,6d000eb07260aff1,f14c6a05fa8c2347] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:42.210 INFO 9 --- [ocp-schedules-30,6d000eb07260aff1,f14c6a05fa8c2347] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:51:42.476 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:42.477 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:42.782 WARN 9 --- [ocp-async-5,33b7fb970107686b,0717793b98f46993] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:42.782 INFO 9 --- [ocp-async-5,91946084e8f7d7b8,5c8e18f186620239] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:43.631 INFO 9 --- [ocp-schedules-19,25fc303fe773f80b,c9f36b391d820459] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:51:43.632 INFO 9 --- [ocp-schedules-19,25fc303fe773f80b,c9f36b391d820459] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:43.636 INFO 9 --- [prometheus-minute-schedule-1,f6db2fc2416becda,d63105486e3949ca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:43.639 INFO 9 --- [prometheus-minute-schedule-1,f6db2fc2416becda,d63105486e3949ca] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:43.680 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:51:43.680 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.683 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:51:43.706 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.707 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:51:43.730 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.731 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:51:43.754 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.754 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:51:43.758 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.759 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:51:43.783 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.783 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:51:43.806 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.807 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:51:43.812 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.812 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:51:43.849 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.850 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:51:43.874 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.875 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:51:43.893 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.894 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:51:43.895 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.896 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:51:43.896 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.897 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:51:43.898 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.899 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:51:43.899 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.900 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:51:43.901 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.901 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:51:43.918 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.919 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:51:43.919 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.920 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:51:43.921 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.921 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:51:43.935 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:51:43.937 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:51:43.962 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:51:43.964 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:43.964 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:51:43.992 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:51:43.992 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:51:43.992 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:51:43.992 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:51:43.992 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:51:43.992 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:51:43.996 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:51:43.996 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:51:43.996 INFO 9 --- [ocp-schedules-19,25fc303fe773f80b,c9f36b391d820459] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:51:44.712 INFO 9 --- [ocp-schedules-14,d64e64a82edb3353,ef4656393fdc0838] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:51:44.782 WARN 9 --- [ocp-async-3,28bb37140c375038,b78f5e13c874313d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:44.782 INFO 9 --- [ocp-async-3,a017ad7ef12a3df8,f18f2e3955c72ecc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:51:44,939 |-INFO in ReconfigureOnChangeTask(born:1758001784939) - Empty watch file list. Disabling 2025-09-16 13:51:45.477 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:45.478 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:46.636 INFO 9 --- [prometheus-minute-schedule-1,a9318318efdcb95d,8a36d9eac861e3d2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:46.639 INFO 9 --- [prometheus-minute-schedule-1,a9318318efdcb95d,8a36d9eac861e3d2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:46.782 WARN 9 --- [ocp-async-8,614614b00951d60c,60971132d6cb4950] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:46.782 INFO 9 --- [ocp-async-9,c43c4f9805bb24d0,63ad1c9be8dd1b9a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:48.478 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:48.479 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:48.782 WARN 9 --- [ocp-async-4,c2e2aa43212c06b2,9b222062630685df] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:48.782 INFO 9 --- [ocp-async-6,c0aea23d22584627,5ea9ee577b4fb904] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:48.947 INFO 9 --- [ocp-schedules-2,4cd4049f5aca19fd,82a6a462ce0a85e3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:51:48.949 INFO 9 --- [ocp-schedules-2,4cd4049f5aca19fd,82a6a462ce0a85e3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:51:49.636 INFO 9 --- [prometheus-minute-schedule-1,e3c245e995fde57a,068767ce14736810] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:49.639 INFO 9 --- [prometheus-minute-schedule-1,e3c245e995fde57a,068767ce14736810] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:51:50.002945+08:00, lastProcessTime=2025-09-16T13:51:40.004387+08:00 2025-09-16 13:51:50.112 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:51:50.002945+08:00 2025-09-16 13:51:50.182 INFO 9 --- [ocp-async-8,934a9766f05056b3,163836b57c0527ca] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:51:50.677 INFO 9 --- [ocp-schedules-6,1c2f836d8da5cb2d,b865bfdb3e811f23] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:51:50.682 WARN 9 --- [scanner-1371493-1,1c2f836d8da5cb2d,caf24baf9e6e9d92] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:51:50.782 WARN 9 --- [ocp-async-1,58f3ab10b82ed32b,1e43fd5488ecfb66] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:50.782 INFO 9 --- [ocp-async-3,bebb11d495385148,ad1e31fba8c03acb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:51.479 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:51.479 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:52.636 INFO 9 --- [prometheus-minute-schedule-1,3219d44371429d73,4ae4756ff38a46d0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:52.639 INFO 9 --- [prometheus-minute-schedule-1,3219d44371429d73,4ae4756ff38a46d0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:52.782 WARN 9 --- [ocp-async-8,60a6dbdeb55b42b3,7aed041cfcd7edd3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:52.782 INFO 9 --- [ocp-async-8,9ee21dd5b501a3cd,14681fd3cc3d250f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:54.479 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:54.480 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:54.591 INFO 9 --- [ocp-schedules-1,cb037e12606442ac,ebaf535ce0f6042f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:51:54.595 INFO 9 --- [ocp-schedules-1,cb037e12606442ac,ebaf535ce0f6042f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:51:54.595 INFO 9 --- [ocp-schedules-1,cb037e12606442ac,ebaf535ce0f6042f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:51:54.716 INFO 9 --- [ocp-schedules-9,384a420511aabdd6,a80c9121e845760a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:51:54.782 WARN 9 --- [ocp-async-4,b7211ec710136666,2735b6411c18c13f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:54.783 INFO 9 --- [ocp-async-4,487cec2b35ebd4ec,d82ca463237b9415] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:55.636 INFO 9 --- [prometheus-minute-schedule-1,7729cf8852dec1b2,8185693ff036eda8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:55.639 INFO 9 --- [prometheus-minute-schedule-1,7729cf8852dec1b2,8185693ff036eda8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:56.783 WARN 9 --- [ocp-async-5,c0f69beca8bd31c7,90c78a7e617a5894] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:56.783 INFO 9 --- [ocp-async-1,3fc2a7b8f9036161,dfa15d634b015aeb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:57.480 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:51:57.481 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:51:58.636 INFO 9 --- [prometheus-minute-schedule-1,16dc37258f51f43e,ef3d033d0bbc461c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001920, interval=60 2025-09-16 13:51:58.639 INFO 9 --- [prometheus-minute-schedule-1,16dc37258f51f43e,ef3d033d0bbc461c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:51:58.783 WARN 9 --- [ocp-async-3,a376a7d6b2042896,fc26c0bf37f83dc6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:51:58.783 INFO 9 --- [ocp-async-9,1db69b7929f11fd0,acc75acf86c2dcdf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:51:58.954 INFO 9 --- [ocp-schedules-1,97fd2bcedc687b5d,db14cf7f9c964a6f] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:51:58.956 INFO 9 --- [ocp-schedules-1,97fd2bcedc687b5d,db14cf7f9c964a6f] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:51:59.938 INFO 9 --- [ocp-schedules-23,1bd93a45a26dac09,4f936bf8f4a0854a] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:51:59.941 INFO 9 --- [ocp-schedules-5,58ad03ba065618ed,db8e0ac94b602413] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:51:59.941 INFO 9 --- [ocp-schedules-24,0b8e3dfd8fd82cb1,ea9adcd2000193c1] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:51:59.942 INFO 9 --- [ocp-schedules-16,a309807fb7502abd,fd7fe06b66770cfc] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:51:59.943 INFO 9 --- [ocp-schedules-24,0b8e3dfd8fd82cb1,ea9adcd2000193c1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:59.943 INFO 9 --- [ocp-schedules-5,58ad03ba065618ed,db8e0ac94b602413] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:59.943 INFO 9 --- [ocp-schedules-16,a309807fb7502abd,fd7fe06b66770cfc] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:51:59.943 INFO 9 --- [ocp-schedules-16,a309807fb7502abd,fd7fe06b66770cfc] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:51:59.944 INFO 9 --- [ocp-schedules-25,aa7098ec27fde89b,ef5c16a10b72b58e] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:51:59.944 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:51:59.944 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:51:59.944 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:51:59.945 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:51:59.945 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:51:59.945 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:51:59.945 INFO 9 --- [ocp-schedules-12,de325e4a27f3b94d,4eb947abc5e6a58f] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:51:59.945 INFO 9 --- [ocp-schedules-6,d6df97840edba91a,d49f04595eabf677] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:51:59.946 INFO 9 --- [host-check-clockdiff1,de325e4a27f3b94d,71d835ff8f8a3344] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:51:59.946 INFO 9 --- [host-check-clockdiff2,de325e4a27f3b94d,ee1652b3eba95e15] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:51:59.946 INFO 9 --- [host-check-clockdiff3,de325e4a27f3b94d,d12edb4bfe86d80f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:51:59.946 INFO 9 --- [host-check-clockdiff4,de325e4a27f3b94d,eb700c9c1c753d1d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:51:59.946 INFO 9 --- [host-check-clockdiff5,de325e4a27f3b94d,def5360580c95cbb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:51:59.946 INFO 9 --- [host-check-agent-status1,d6df97840edba91a,33e02a6219757c2e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:51:59.946 INFO 9 --- [host-check-clockdiff6,de325e4a27f3b94d,44290ad65224a098] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:51:59.946 INFO 9 --- [host-check-agent-status2,d6df97840edba91a,e702cdca0b4f08f1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:51:59.946 INFO 9 --- [host-check-agent-status3,d6df97840edba91a,8049a339ef616cb2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:51:59.946 INFO 9 --- [host-check-agent-status4,d6df97840edba91a,cdd35e709bf86c81] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:51:59.946 INFO 9 --- [host-check-agent-status5,d6df97840edba91a,74ca9060600c797c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:51:59.946 INFO 9 --- [host-check-agent-status6,d6df97840edba91a,1821da9a6a93c7d8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:51:59.955 INFO 9 --- [host-check-clockdiff2,de325e4a27f3b94d,ee1652b3eba95e15] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001919 -1 -1 , error= 2025-09-16 13:51:59.955 INFO 9 --- [host-check-clockdiff3,de325e4a27f3b94d,d12edb4bfe86d80f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001919 -1 -1 , error= 2025-09-16 13:51:59.956 INFO 9 --- [host-check-clockdiff1,de325e4a27f3b94d,71d835ff8f8a3344] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001919 -1 -1 , error= 2025-09-16 13:51:59.956 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:51:59.959 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:51:59.959 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:51:59.959 INFO 9 --- [host-check-clockdiff5,de325e4a27f3b94d,def5360580c95cbb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001919 -1 -1 , error= 2025-09-16 13:51:59.960 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:51:59.960 INFO 9 --- [host-check-clockdiff6,de325e4a27f3b94d,44290ad65224a098] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001919 -1 -1 , error= 2025-09-16 13:51:59.961 INFO 9 --- [ocp-schedules-9,f34872091f873222,69829ddd6dbe8e16] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:51:59.961 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:51:59.961 INFO 9 --- [host-check-clockdiff4,de325e4a27f3b94d,eb700c9c1c753d1d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001919 -1 -1 , error= 2025-09-16 13:51:59.961 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:59.961 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:59.961 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:51:59.961 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:51:59.962 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:51:59.962 INFO 9 --- [host-check-agent-status1,d6df97840edba91a,33e02a6219757c2e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:51:59.962 INFO 9 --- [host-check-agent-status2,d6df97840edba91a,e702cdca0b4f08f1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:51:59.962 INFO 9 --- [host-check-agent-status5,d6df97840edba91a,74ca9060600c797c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:51:59.962 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:59.962 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:51:59.963 INFO 9 --- [host-check-agent-status6,d6df97840edba91a,1821da9a6a93c7d8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:59.963 INFO 9 --- [host-check-agent-status1,d6df97840edba91a,33e02a6219757c2e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:51:59.963 INFO 9 --- [host-check-agent-status4,d6df97840edba91a,cdd35e709bf86c81] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:51:59.963 INFO 9 --- [host-check-agent-status2,d6df97840edba91a,e702cdca0b4f08f1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:51:59.963 INFO 9 --- [host-check-agent-status5,d6df97840edba91a,74ca9060600c797c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:59.963 INFO 9 --- [host-check-agent-status6,d6df97840edba91a,1821da9a6a93c7d8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:59.964 INFO 9 --- [host-check-agent-status3,d6df97840edba91a,8049a339ef616cb2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:51:59.964 INFO 9 --- [host-check-agent-status4,d6df97840edba91a,cdd35e709bf86c81] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:51:59.965 INFO 9 --- [host-check-agent-status3,d6df97840edba91a,8049a339ef616cb2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:51:59.976 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:51:59.977 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:51:59.977 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:51:59.977 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:51:59.978 INFO 9 --- [host-check-agent-status5,d6df97840edba91a,74ca9060600c797c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:51:59.978 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:51:59.978 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:51:59.979 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:51:59.977844435+08:00 2025-09-16 13:51:59.979 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:51:59.977402880+08:00 2025-09-16 13:51:59.979 INFO 9 --- [host-check-agent-status1,d6df97840edba91a,33e02a6219757c2e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:51:59.979 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:51:59.979+08:00 2025-09-16 13:51:59.979 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:51:59.979+08:00 2025-09-16 13:51:59.979 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:51:59.978171456+08:00 2025-09-16 13:51:59.979 INFO 9 --- [host-check-agent-status2,d6df97840edba91a,e702cdca0b4f08f1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:51:59.979 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:51:59.978595009+08:00 2025-09-16 13:51:59.979 INFO 9 --- [host-check-agent-status6,d6df97840edba91a,1821da9a6a93c7d8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:51:59.979 INFO 9 --- [host-check-agent-status4,d6df97840edba91a,cdd35e709bf86c81] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:51:59.979 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:51:59.979+08:00 2025-09-16 13:51:59.980 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:51:59.979+08:00 2025-09-16 13:51:59.980 INFO 9 --- [host-check-agent-status3,d6df97840edba91a,8049a339ef616cb2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:51:59.980 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:59.980 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:51:59.979172500+08:00 2025-09-16 13:51:59.980 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:51:59.979104699+08:00 2025-09-16 13:51:59.980 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:51:59.980 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:51:59.980+08:00 2025-09-16 13:51:59.981 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:51:59.979+08:00 and status AVAILABLE 2025-09-16 13:51:59.981 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:51:59.979+08:00 and status AVAILABLE 2025-09-16 13:51:59.981 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:51:59.980+08:00 2025-09-16 13:51:59.981 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:51:59.979+08:00 and status AVAILABLE 2025-09-16 13:51:59.981 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:51:59.979+08:00 and status AVAILABLE 2025-09-16 13:51:59.981 INFO 9 --- [host-check-agent-status1,d6df97840edba91a,33e02a6219757c2e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:51:59.981 INFO 9 --- [host-check-agent-status1,d6df97840edba91a,33e02a6219757c2e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:51:59.981 INFO 9 --- [host-check-agent-status1,d6df97840edba91a,33e02a6219757c2e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:51:59.982 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:51:59.980+08:00 and status AVAILABLE 2025-09-16 13:51:59.982 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:51:59.980+08:00 and status AVAILABLE 2025-09-16 13:51:59.982 INFO 9 --- [host-check-agent-status6,d6df97840edba91a,1821da9a6a93c7d8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:51:59.982 INFO 9 --- [host-check-agent-status6,d6df97840edba91a,1821da9a6a93c7d8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:51:59.982 INFO 9 --- [host-check-agent-status6,d6df97840edba91a,1821da9a6a93c7d8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:51:59.982 INFO 9 --- [host-check-agent-status4,d6df97840edba91a,cdd35e709bf86c81] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:51:59.982 INFO 9 --- [host-check-agent-status4,d6df97840edba91a,cdd35e709bf86c81] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:51:59.982 INFO 9 --- [host-check-agent-status4,d6df97840edba91a,cdd35e709bf86c81] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:51:59.983 INFO 9 --- [host-check-agent-status3,d6df97840edba91a,8049a339ef616cb2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:51:59.983 INFO 9 --- [host-check-agent-status3,d6df97840edba91a,8049a339ef616cb2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:51:59.983 INFO 9 --- [host-check-agent-status3,d6df97840edba91a,8049a339ef616cb2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:51:59.983 INFO 9 --- [host-check-agent-status2,d6df97840edba91a,e702cdca0b4f08f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:51:59.983 INFO 9 --- [host-check-agent-status2,d6df97840edba91a,e702cdca0b4f08f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:51:59.983 INFO 9 --- [host-check-agent-status2,d6df97840edba91a,e702cdca0b4f08f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:51:59.983 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:51:59.984 INFO 9 --- [host-check-agent-status5,d6df97840edba91a,74ca9060600c797c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:51:59.984 INFO 9 --- [host-check-agent-status5,d6df97840edba91a,74ca9060600c797c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:51:59.984 INFO 9 --- [host-check-agent-status5,d6df97840edba91a,74ca9060600c797c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:51:59.985 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:51:59.985 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:51:59.985 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:51:59.985 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:51:59.985 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:51:59.986 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:51:59.986 INFO 9 --- [ocp-schedules-24,0b8e3dfd8fd82cb1,ea9adcd2000193c1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:51:59.990 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:51:59.990 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:51:59.991 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:51:59.991 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:51:59.991 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:51:59.991 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:51:59.991 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:51:59.991 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:51:59.991 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:51:59.992 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:51:59.992 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:51:59.992 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:51:59.993 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:51:59.994 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:52:00.004 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:52:00.003954+08:00, lastProcessTime=2025-09-16T13:51:50.002945+08:00 2025-09-16 13:52:00.005 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:00.005 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:00.005 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:00.005 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:00.006 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:00.032 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:52:00.032 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:52:00.033 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:52:00.033 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:52:00.034 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:52:00.034 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:52:00.036 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:00.038 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:00.039 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:52:00.039 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:52:00.039 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:52:00.040 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:52:00.040 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:52:00.040 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:52:00.041 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:52:00.051 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:00.052 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:00.052 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:00.052 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:00.052 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:00.053 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:00.075 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:00.076 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:00.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:52:00.079 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:52:00.080 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:52:00.080 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:52:00.080 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:00.081 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:52:00.083 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:52:00.084 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:00.085 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:52:00.086 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:52:00.086 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:52:00.086 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:52:00.087 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:52:00.087 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:52:00.092 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:52:00.094 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:52:00.098 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:00.099 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.099 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:00.099 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:00.100 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:00.100 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:00.103 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:00.105 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:00.115 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.115 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:00.127 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:52:00.127 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:52:00.128 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:52:00.130 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.130 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:00.131 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:52:00.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:52:00.003954+08:00 2025-09-16 13:52:00.133 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:52:00.134 INFO 9 --- [host-check-host-status5,aa7098ec27fde89b,1d3ca30f61898a46] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:52:00.134 INFO 9 --- [host-check-host-status2,aa7098ec27fde89b,29befc1c1bdc62b8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:52:00.134 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:52:00.135 INFO 9 --- [host-check-host-status3,aa7098ec27fde89b,986c7d8beae0e7f3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:52:00.139 INFO 9 --- [host-check-host-status4,aa7098ec27fde89b,45133f00abd92775] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:52:00.140 INFO 9 --- [host-check-host-status6,aa7098ec27fde89b,b6ce91bc7a28feae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:52:00.140 INFO 9 --- [host-check-host-status1,aa7098ec27fde89b,afacb36c07c5478a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:52:00.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:00.161 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.161 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:00.182 INFO 9 --- [ocp-async-10,2f45bfb4678fca14,211c1a1120bf3161] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:52:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:00.233 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:00.247 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:00.249 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:00.249 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:00.254 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:52:00.257 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:52:00.260 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:00.274 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:52:00.336 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:52:00.350 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:00.352 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:00.352 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:52:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:52:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:52:00.366 INFO 9 --- [ocp-schedules-5,58ad03ba065618ed,db8e0ac94b602413] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:52:00.481 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:00.481 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:00.703 INFO 9 --- [ocp-schedules-23,12aee7dec5d52517,0ea75f9cd3d294d0] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:52:00.709 WARN 9 --- [scanner-1371627-1,12aee7dec5d52517,bd55f52f80085c7c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:52:00.719 INFO 9 --- [alarm-detect-18,12aee7dec5d52517,5a1c2d8836361527] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:52:00.720 INFO 9 --- [alarm-detect-17,12aee7dec5d52517,8d212585becefb1d] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:52:00.720 INFO 9 --- [alarm-detect-8,12aee7dec5d52517,4993aaa2cec7421a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:52:00.733 INFO 9 --- [alarm-detect-19,12aee7dec5d52517,3f0d76027e82ff79] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:52:00.783 WARN 9 --- [ocp-async-2,ced0d8027c0e32d6,eb260b25b7a95602] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:00.783 INFO 9 --- [ocp-async-6,c3aae8f25d2e3d46,94d69496b5d21732] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:00.836 INFO 9 --- [ocp-schedules-8,f8411287420e00d4,737649c147d08c81] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:52:01.636 INFO 9 --- [prometheus-minute-schedule-1,0654dcb4e95de7ce,d689a6869fd9cf34] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:01.639 INFO 9 --- [prometheus-minute-schedule-1,0654dcb4e95de7ce,d689a6869fd9cf34] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:02.783 INFO 9 --- [ocp-async-10,3766e9d019318d32,2f04c961e58ec09f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:02.783 WARN 9 --- [ocp-async-5,c6e82b902b49f0ae,98fdf9131543429e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:03.007 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,3efa1b3cacfffae3,7f80c9c9c9d61612] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=3efa1b3cacfffae3, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:52:03.007 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,3efa1b3cacfffae3,7f80c9c9c9d61612] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=3efa1b3cacfffae3, duration=1 ms] 2025-09-16 13:52:03.482 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:03.482 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:04.636 INFO 9 --- [prometheus-minute-schedule-1,153b3d0ce5c96a60,59b38ed62da65e8e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:04.639 INFO 9 --- [prometheus-minute-schedule-1,153b3d0ce5c96a60,59b38ed62da65e8e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:04.719 INFO 9 --- [ocp-schedules-7,d39672dcdadfa7aa,2e68e234a97183aa] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:52:04.783 INFO 9 --- [ocp-async-3,27e282a006d99b9a,bdacba55f6fb2e61] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:04.783 WARN 9 --- [ocp-async-7,fb77befdd04cede1,761025cc3df00279] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:06.482 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:06.483 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:06.783 INFO 9 --- [ocp-async-8,00ec71c8c2ad3e21,e5a463fbbe0fe9b4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:06.783 WARN 9 --- [ocp-async-4,ab4b3986598774b7,6e7ff385d84ae7e9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:07.636 INFO 9 --- [prometheus-minute-schedule-1,46a5283108854426,19241fb26c38cf62] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:07.639 INFO 9 --- [prometheus-minute-schedule-1,46a5283108854426,19241fb26c38cf62] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:08.783 INFO 9 --- [ocp-async-6,357dd72cbc6a4b3e,3b85c062b0fe4c81] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:08.783 WARN 9 --- [ocp-async-5,1d22eb12e3bfdf19,93a3f30d183a264f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:08.960 INFO 9 --- [ocp-schedules-27,707fb23952da918b,890265896d56b266] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:52:08.962 INFO 9 --- [ocp-schedules-27,707fb23952da918b,890265896d56b266] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:52:09.483 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:09.484 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:10.002 INFO 9 --- [ocp-schedules-14,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:52:10.002 INFO 9 --- [ocp-schedules-3,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:52:10.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:52:10.003265+08:00, lastProcessTime=2025-09-16T13:52:00.003954+08:00 2025-09-16 13:52:10.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:52:10.003265+08:00 2025-09-16 13:52:10.182 INFO 9 --- [ocp-async-4,6e29d6e9709ba3cd,3f0d6d497f5ebdec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:52:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:52:10.636 INFO 9 --- [prometheus-minute-schedule-1,dd5fb9df4c6a5537,734d425040cc949e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:10.639 INFO 9 --- [prometheus-minute-schedule-1,dd5fb9df4c6a5537,734d425040cc949e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:10.735 INFO 9 --- [ocp-schedules-1,edc517d4ee85814e,693979a8867be5bf] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:52:10.741 WARN 9 --- [scanner-1371795-1,edc517d4ee85814e,0431b1092fbd27dd] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:52:10.783 INFO 9 --- [ocp-async-9,bb8205551bfdb059,ed4dc71e5089fc26] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:10.783 WARN 9 --- [ocp-async-7,6a6d46b3b27d332b,748faf254754a6c9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:11.722 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001860, nodeCount=460, affectRows=460 2025-09-16 13:52:12.484 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:12.485 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:12.783 INFO 9 --- [ocp-async-9,df1363e83f618e86,4af0e0e5a5750c8c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:12.783 WARN 9 --- [ocp-async-2,dc557480f925c8bd,020b4c6d1c613bdc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:12.928 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001860, nodeCount=1000, affectRows=1000 2025-09-16 13:52:12.931 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001860, nodeCount=1000, validCount=996 2025-09-16 13:52:12.956 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001860, nodeCount=1000, affectRows=1000 2025-09-16 13:52:12.959 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001860, nodeCount=1000, validCount=998 2025-09-16 13:52:12.970 ERROR 9 --- [metric-archive-second-5,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221684167) Duplicate entry '824401952599621632-1758001800' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221684167) Duplicate entry '824401952599621632-1758001800' for key 'PRIMARY' 2025-09-16 13:52:13.636 INFO 9 --- [prometheus-minute-schedule-1,0482a0bf499ef0fe,f9bea1cdc43f18cc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:13.639 INFO 9 --- [prometheus-minute-schedule-1,0482a0bf499ef0fe,f9bea1cdc43f18cc] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:14.289 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001860, nodeCount=1000, affectRows=1000 2025-09-16 13:52:14.291 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001860, nodeCount=991, validCount=945 2025-09-16 13:52:14.315 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001860, nodeCount=853, affectRows=853 2025-09-16 13:52:14.317 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001860, nodeCount=853, validCount=851 2025-09-16 13:52:14.597 INFO 9 --- [ocp-schedules-28,ae539b349fe1b519,2f4b077639a432e5] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:52:14.602 INFO 9 --- [ocp-schedules-28,ae539b349fe1b519,2f4b077639a432e5] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:52:14.602 INFO 9 --- [ocp-schedules-28,ae539b349fe1b519,2f4b077639a432e5] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:52:14.722 INFO 9 --- [ocp-schedules-30,760a3f46747972c1,c6f0c9ce7c928baf] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:52:14.784 INFO 9 --- [ocp-async-9,831fb9c87ae0b026,53e2e671ba9d78ac] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:14.784 WARN 9 --- [ocp-async-5,96dd2ff187b9249d,3c85376c0d1a28f5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:15.485 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:15.486 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:16.636 INFO 9 --- [prometheus-minute-schedule-1,9b319415f3ffbccc,4b3d63a5b132e8b0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:16.639 INFO 9 --- [prometheus-minute-schedule-1,9b319415f3ffbccc,4b3d63a5b132e8b0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:16.784 INFO 9 --- [ocp-async-9,0201b61407d77289,21f398607836f41b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:16.784 WARN 9 --- [ocp-async-10,e3cb2c7a1eeff4fc,6c1e42997fc86ed8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:18.486 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:18.487 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:18.784 INFO 9 --- [ocp-async-9,4d09a951f4338562,e71801431e5236b5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:18.784 WARN 9 --- [ocp-async-4,a3ea98f8809c8549,760ab35c7e7ed00d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:18.966 INFO 9 --- [ocp-schedules-14,7d93dc222f0a263e,fdc0b3118b8e2980] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:52:18.968 INFO 9 --- [ocp-schedules-14,7d93dc222f0a263e,fdc0b3118b8e2980] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:52:19.636 INFO 9 --- [prometheus-minute-schedule-1,8fc4bf20a36976f0,c569a932e9dd8b3f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:19.639 INFO 9 --- [prometheus-minute-schedule-1,8fc4bf20a36976f0,c569a932e9dd8b3f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:52:20.002956+08:00, lastProcessTime=2025-09-16T13:52:10.003265+08:00 2025-09-16 13:52:20.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:52:20.002956+08:00 2025-09-16 13:52:20.182 INFO 9 --- [ocp-async-10,7a1adb1c99db0dcf,f20b55297306ff4f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:52:20.636 INFO 9 --- [prometheus-cache-monitor1,99956772ac41f6e5,be995198bc331dfd] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:52:20.636 INFO 9 --- [prometheus-cache-monitor1,99956772ac41f6e5,be995198bc331dfd] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:52:20.761 INFO 9 --- [ocp-schedules-21,1818ef228acd9292,8328973c8dd86993] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:52:20.766 WARN 9 --- [scanner-1372791-1,1818ef228acd9292,3ec329f1552b888b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:52:20.776 INFO 9 --- [alarm-detect-15,1818ef228acd9292,083cca56e47ba9f3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:52:20.778 INFO 9 --- [alarm-detect-3,1818ef228acd9292,d34dbe40b96afa03] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:52:20.778 INFO 9 --- [alarm-detect-7,1818ef228acd9292,fe25d6fa4118a48c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:52:20.784 INFO 9 --- [ocp-async-5,76a49b605ed3614f,20a6572f2d848e79] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:20.784 WARN 9 --- [ocp-async-6,9bae1ee41830f6f1,15ef49a3dcea5d52] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:20.791 INFO 9 --- [alarm-detect-6,1818ef228acd9292,58185f56ba2ef1f3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:52:21.487 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:21.487 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:22.636 INFO 9 --- [prometheus-minute-schedule-1,c2be829a24e9be63,2364d9f58ee9bc13] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:22.639 INFO 9 --- [prometheus-minute-schedule-1,c2be829a24e9be63,2364d9f58ee9bc13] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:22.784 INFO 9 --- [ocp-async-5,6caaf2c15390566a,96a36a17c59650a1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:22.784 WARN 9 --- [ocp-async-10,fdca6d776f457286,22cb445c36fdd3e2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:24.487 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:24.488 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:24.726 INFO 9 --- [ocp-schedules-3,556133f047e1b0fd,7d8de382abb48e48] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:52:24.784 WARN 9 --- [ocp-async-8,56cdbd00188eaaaa,60cb4347b815989e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:24.784 INFO 9 --- [ocp-async-5,e21407402f223777,673b4192f9fc8e28] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:25.636 INFO 9 --- [prometheus-minute-schedule-1,c35357db502ed95d,3119fda818562d0b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:25.639 INFO 9 --- [prometheus-minute-schedule-1,c35357db502ed95d,3119fda818562d0b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:26.784 INFO 9 --- [ocp-async-9,2fdbc9b55a664dbd,37d943d580a1c3bf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:26.784 WARN 9 --- [ocp-async-6,3b5e30ea45fee258,674648c9bb1e21cb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:27.488 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:27.489 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:28.636 INFO 9 --- [prometheus-minute-schedule-1,72b10b089390b7f5,973806049c52483a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:28.639 INFO 9 --- [prometheus-minute-schedule-1,72b10b089390b7f5,973806049c52483a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:28.784 INFO 9 --- [ocp-async-3,8321a5a80243b6a0,d61106f8e42adfe5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:28.784 WARN 9 --- [ocp-async-7,e1f8643592602535,acb24731030838cf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:28.972 INFO 9 --- [ocp-schedules-14,ca6e277fdd3bc67f,335cf9fe67dc3ab3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:52:28.975 INFO 9 --- [ocp-schedules-14,ca6e277fdd3bc67f,335cf9fe67dc3ab3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:52:29.938 INFO 9 --- [ocp-schedules-22,1936831f7518edbf,55c0da3afafa394f] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:52:29.941 INFO 9 --- [ocp-schedules-23,f26dc9376242adbb,bcb1ebe4d4ede680] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:52:29.941 INFO 9 --- [ocp-schedules-2,fab9606423a5d70e,0efad88698ca2f92] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:52:29.942 INFO 9 --- [ocp-schedules-5,561344abe42c1e0f,14150d7ea7b96dc0] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:52:29.942 INFO 9 --- [ocp-schedules-23,f26dc9376242adbb,bcb1ebe4d4ede680] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:29.943 INFO 9 --- [ocp-schedules-2,fab9606423a5d70e,0efad88698ca2f92] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:29.943 INFO 9 --- [ocp-schedules-5,561344abe42c1e0f,14150d7ea7b96dc0] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:29.943 INFO 9 --- [ocp-schedules-5,561344abe42c1e0f,14150d7ea7b96dc0] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:52:29.944 INFO 9 --- [ocp-schedules-3,0087dbfc86ee1333,6925556ff4977f00] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:29.944 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:52:29.944 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:52:29.944 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:52:29.944 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:52:29.944 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:52:29.944 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:52:29.945 INFO 9 --- [ocp-schedules-18,bb9eccb13db4d957,33445ab11614b8ac] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:29.945 INFO 9 --- [ocp-schedules-6,86281d561b151363,3d8a4337d8583f7a] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:29.945 INFO 9 --- [host-check-clockdiff1,bb9eccb13db4d957,55f161dcb0df74a0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:52:29.945 INFO 9 --- [host-check-clockdiff2,bb9eccb13db4d957,fb5545f5a6914b7a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:52:29.945 INFO 9 --- [host-check-agent-status1,86281d561b151363,80bdb8f3479a69c4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:52:29.945 INFO 9 --- [host-check-clockdiff3,bb9eccb13db4d957,acc4d6d5db9cbe67] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:52:29.945 INFO 9 --- [host-check-agent-status2,86281d561b151363,d753e97f6b10ca11] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:52:29.945 INFO 9 --- [host-check-clockdiff4,bb9eccb13db4d957,a5e0ef127728c00e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:52:29.946 INFO 9 --- [host-check-agent-status3,86281d561b151363,98515c8ceb9e97a8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:52:29.946 INFO 9 --- [host-check-clockdiff5,bb9eccb13db4d957,877a69324874417f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:52:29.946 INFO 9 --- [host-check-agent-status4,86281d561b151363,c45e5b22af6be728] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:52:29.946 INFO 9 --- [host-check-clockdiff6,bb9eccb13db4d957,acb45702287810ed] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:52:29.946 INFO 9 --- [host-check-agent-status5,86281d561b151363,0395f60c98e51a22] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:52:29.946 INFO 9 --- [host-check-agent-status6,86281d561b151363,4456e4028a6e00dc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:52:29.950 INFO 9 --- [host-check-clockdiff2,bb9eccb13db4d957,fb5545f5a6914b7a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001949 -2 -2 , error= 2025-09-16 13:52:29.951 INFO 9 --- [ocp-schedules-13,755cea9a5f9ed74e,7252cb306df78147] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:52:29.954 INFO 9 --- [host-check-clockdiff5,bb9eccb13db4d957,877a69324874417f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001949 -1 -1 , error= 2025-09-16 13:52:29.954 INFO 9 --- [host-check-clockdiff3,bb9eccb13db4d957,acc4d6d5db9cbe67] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001949 -1 -1 , error= 2025-09-16 13:52:29.955 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:52:29.955 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:52:29.956 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:52:29.956 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:52:29.956 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:29.957 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:52:29.957 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:52:29.958 INFO 9 --- [host-check-agent-status6,86281d561b151363,4456e4028a6e00dc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:29.958 INFO 9 --- [host-check-agent-status3,86281d561b151363,98515c8ceb9e97a8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:52:29.958 INFO 9 --- [host-check-agent-status4,86281d561b151363,c45e5b22af6be728] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:52:29.958 INFO 9 --- [host-check-clockdiff6,bb9eccb13db4d957,acb45702287810ed] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001949 -1 -1 , error= 2025-09-16 13:52:29.958 INFO 9 --- [host-check-clockdiff4,bb9eccb13db4d957,a5e0ef127728c00e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001949 -1 -1 , error= 2025-09-16 13:52:29.958 INFO 9 --- [host-check-agent-status1,86281d561b151363,80bdb8f3479a69c4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:52:29.959 INFO 9 --- [host-check-agent-status5,86281d561b151363,0395f60c98e51a22] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:52:29.959 INFO 9 --- [host-check-agent-status6,86281d561b151363,4456e4028a6e00dc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:29.959 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:52:29.959 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:29.959 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:52:29.959 INFO 9 --- [host-check-agent-status3,86281d561b151363,98515c8ceb9e97a8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:52:29.959 INFO 9 --- [host-check-agent-status4,86281d561b151363,c45e5b22af6be728] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:52:29.959 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:52:29.959 INFO 9 --- [host-check-agent-status2,86281d561b151363,d753e97f6b10ca11] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:52:29.959 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:52:29.959 INFO 9 --- [host-check-agent-status1,86281d561b151363,80bdb8f3479a69c4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:52:29.960 INFO 9 --- [host-check-agent-status5,86281d561b151363,0395f60c98e51a22] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:52:29.960 INFO 9 --- [host-check-agent-status2,86281d561b151363,d753e97f6b10ca11] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:52:29.962 INFO 9 --- [ocp-schedules-21,ad0b45b5978e34ae,71f5489b79edb935] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:52:29.963 INFO 9 --- [ocp-schedules-27,410179306643eb55,0b328e7ee693f482] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:52:29.968 INFO 9 --- [ocp-schedules-21,ad0b45b5978e34ae,71f5489b79edb935] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:52:29.969 INFO 9 --- [ocp-schedules-27,410179306643eb55,0b328e7ee693f482] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:52:29.973 INFO 9 --- [host-check-agent-status4,86281d561b151363,c45e5b22af6be728] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:52:29.973 INFO 9 --- [host-check-agent-status6,86281d561b151363,4456e4028a6e00dc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:52:29.973 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:52:29.974 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:52:29.974 INFO 9 --- [host-check-agent-status3,86281d561b151363,98515c8ceb9e97a8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:52:29.974 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:52:29.975 INFO 9 --- [host-check-agent-status1,86281d561b151363,80bdb8f3479a69c4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:52:29.975 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:52:29.975 INFO 9 --- [host-check-agent-status5,86281d561b151363,0395f60c98e51a22] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:52:29.975 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:52:29.975 INFO 9 --- [host-check-agent-status2,86281d561b151363,d753e97f6b10ca11] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:52:29.975 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:52:29.974771801+08:00 2025-09-16 13:52:29.976 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:52:29.974514261+08:00 2025-09-16 13:52:29.976 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:52:29.976 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:52:29.974838323+08:00 2025-09-16 13:52:29.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:29.976 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:52:29.975+08:00 2025-09-16 13:52:29.976 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:52:29.976+08:00 2025-09-16 13:52:29.976 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:52:29.976+08:00 2025-09-16 13:52:29.976 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:52:29.975233732+08:00 2025-09-16 13:52:29.977 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:29.977 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:52:29.976+08:00 2025-09-16 13:52:29.977 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:52:29.976163465+08:00 2025-09-16 13:52:29.977 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:52:29.977+08:00 2025-09-16 13:52:29.977 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:52:29.976470611+08:00 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status6,86281d561b151363,4456e4028a6e00dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status6,86281d561b151363,4456e4028a6e00dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status6,86281d561b151363,4456e4028a6e00dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:52:29.978 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:52:29.975+08:00 and status AVAILABLE 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status4,86281d561b151363,c45e5b22af6be728] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status4,86281d561b151363,c45e5b22af6be728] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status4,86281d561b151363,c45e5b22af6be728] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:52:29.978 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:52:29.976+08:00 and status AVAILABLE 2025-09-16 13:52:29.978 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:52:29.977+08:00 2025-09-16 13:52:29.978 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:52:29.976+08:00 and status AVAILABLE 2025-09-16 13:52:29.978 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:52:29.976+08:00 and status AVAILABLE 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status3,86281d561b151363,98515c8ceb9e97a8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status3,86281d561b151363,98515c8ceb9e97a8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:52:29.978 INFO 9 --- [host-check-agent-status3,86281d561b151363,98515c8ceb9e97a8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:52:29.979 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:52:29.977+08:00 and status AVAILABLE 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status1,86281d561b151363,80bdb8f3479a69c4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status1,86281d561b151363,80bdb8f3479a69c4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status1,86281d561b151363,80bdb8f3479a69c4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status2,86281d561b151363,d753e97f6b10ca11] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status2,86281d561b151363,d753e97f6b10ca11] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status2,86281d561b151363,d753e97f6b10ca11] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status5,86281d561b151363,0395f60c98e51a22] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status5,86281d561b151363,0395f60c98e51a22] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:52:29.979 INFO 9 --- [host-check-agent-status5,86281d561b151363,0395f60c98e51a22] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:52:29.979 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:52:29.977+08:00 and status AVAILABLE 2025-09-16 13:52:29.981 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:52:29.982 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:52:29.982 INFO 9 --- [ocp-schedules-2,fab9606423a5d70e,0efad88698ca2f92] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:52:29.982 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:52:29.982 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:52:29.982 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:52:29.982 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:52:29.983 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:52:29.987 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:52:29.988 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:52:29.988 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:52:29.988 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:29.988 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:52:29.988 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:52:29.988 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:52:29.988 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:52:29.989 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:29.989 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:52:29.989 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:52:29.989 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:52:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:29.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:52:30.002 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:30.002 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:30.002 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:30.002 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:30.003 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:52:30.003517+08:00, lastProcessTime=2025-09-16T13:52:20.002956+08:00 2025-09-16 13:52:30.009 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:52:30.029 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:30.029 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:52:30.029 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:52:30.029 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:52:30.030 INFO 9 --- [ocp-schedules-25,2b191c564ee44fd9,842bab8d873a3eae] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16768,"secondWriteQueue":0,"minuteWriteCacheSize":7202} 2025-09-16 13:52:30.030 INFO 9 --- [ocp-schedules-25,2b191c564ee44fd9,842bab8d873a3eae] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:52:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:30.031 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:52:30.031 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:52:30.031 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:52:30.036 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:52:30.036 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:52:30.036 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:52:30.037 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:52:30.038 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:52:30.038 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:52:30.045 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:52:30.048 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:30.049 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:30.050 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:30.050 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:30.051 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:30.057 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:52:30.065 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:30.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:30.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:52:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:52:30.074 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:30.076 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:52:30.078 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:52:30.078 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:52:30.078 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:52:30.079 INFO 9 --- [ocp-schedules-15,5de3dc6e23e9aa06,56800e313788a541] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:52:30.079 INFO 9 --- [ocp-schedules-15,5de3dc6e23e9aa06,56800e313788a541] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:52:30.081 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:52:30.082 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:52:30.084 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:52:30.084 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:52:30.084 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:52:30.086 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:52:30.087 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:52:30.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:30.093 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:52:30.094 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:30.096 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:30.097 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:30.097 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:30.099 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:30.101 INFO 9 --- [prometheus-second-schedule-1,fabc0654a7baa7c8,1cc290bed6796347] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:52:30.105 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:52:30.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:30.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:30.124 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:52:30.124 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:52:30.124 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:52:30.124 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:52:30.128 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:52:30.131 INFO 9 --- [host-check-host-status4,0087dbfc86ee1333,031996cd8d70903b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:52:30.131 INFO 9 --- [host-check-host-status3,0087dbfc86ee1333,7189d1fe6584f5c1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:52:30.131 INFO 9 --- [host-check-host-status2,0087dbfc86ee1333,f4572a564cf9b80c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:52:30.131 INFO 9 --- [host-check-host-status5,0087dbfc86ee1333,1daef129f25eeb20] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:52:30.133 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:52:30.134 INFO 9 --- [host-check-host-status1,0087dbfc86ee1333,5fa1db38a8480af1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:52:30.134 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:52:30.003517+08:00 2025-09-16 13:52:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:30.141 INFO 9 --- [host-check-host-status6,0087dbfc86ee1333,a86cebefb5092919] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:52:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:30.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:30.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:30.182 INFO 9 --- [ocp-async-9,f11a833e765d261b,f8a3f45504576deb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:52:30.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:52:30.204 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.204 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:52:30.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:52:30.232 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:30.234 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:30.235 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:30.240 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:52:30.243 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:52:30.246 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:30.247 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:30.260 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:52:30.270 INFO 9 --- [ocp-schedules-10,0d18eaf44429ab40,1fe2a2afb951e679] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:52:30.271 INFO 9 --- [ocp-schedules-10,0d18eaf44429ab40,1fe2a2afb951e679] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:30.271 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:52:30.271 INFO 9 --- [ocp-schedules-10,0d18eaf44429ab40,1fe2a2afb951e679] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:52:30.273 INFO 9 --- [ocp-schedules-26,595596757624c7e1,2a308b7718f4bcef] c.o.o.s.common.scheduled.HostSchedules : Check host version schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:30.274 INFO 9 --- [ocp-schedules-26,595596757624c7e1,2a308b7718f4bcef] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-version, skip execute 2025-09-16 13:52:30.321 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:52:30.335 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:30.336 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:30.337 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:52:30.352 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:52:30.352 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:52:30.352 INFO 9 --- [ocp-schedules-23,f26dc9376242adbb,bcb1ebe4d4ede680] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:52:30.398 INFO 9 --- [ocp-schedules-4,3b56a5ea100c8857,09046b72fc8456a7] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:52:30.489 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:30.490 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:30.574 INFO 9 --- [ocp-schedules-30,02c1d393ad049e57,9d25305421469d07] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:52:30.576 INFO 9 --- [ocp-schedules-30,02c1d393ad049e57,9d25305421469d07] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:52:30.576 INFO 9 --- [ocp-schedules-30,02c1d393ad049e57,9d25305421469d07] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:52:30.785 WARN 9 --- [ocp-async-1,c7950d09e8bb3b1c,904ab5a5ef62ce30] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:30.785 INFO 9 --- [ocp-async-6,08058bed2a329fa5,ae048f3200c78b0d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:30.794 INFO 9 --- [ocp-schedules-19,2e06b70efd40d190,55ccdc9ca894f4ce] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:52:30.799 WARN 9 --- [scanner-1372954-1,2e06b70efd40d190,a9ac902e0020f998] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:52:30.838 INFO 9 --- [ocp-schedules-7,9676fba5b32a653e,334610761ed9604b] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:52:30.888 INFO 9 --- [host-check-clockdiff1,bb9eccb13db4d957,55f161dcb0df74a0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001950 -1 -1 , error= 2025-09-16 13:52:30.970 INFO 9 --- [ocp-schedules-20,0155789171b0cfae,3ac9ea7aaecd4619] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:52:30.970 INFO 9 --- [ocp-schedules-20,0155789171b0cfae,3ac9ea7aaecd4619] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:52:31.464 INFO 9 --- [ocp-schedules-1,aa3e2cdf9ed3a614,ba276acdb61c1456] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:52:31.464 INFO 9 --- [ocp-schedules-1,aa3e2cdf9ed3a614,ba276acdb61c1456] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758001951 2025-09-16 13:52:31.464 INFO 9 --- [ocp-schedules-1,aa3e2cdf9ed3a614,ba276acdb61c1456] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:52:31.468 INFO 9 --- [ocp-schedules-1,aa3e2cdf9ed3a614,ba276acdb61c1456] c.o.o.m.p.OcpMetricPublishServiceImpl : Register meter successfully, metric = Metric{name='proxy_memory_used_bytes', labels={mode_name=OB_SQL_STRING, ocp_address=10.233.116.22:8080}}, value: 1088, timestamp: 1758001951 : 2025-09-16 05:52:31 2025-09-16 13:52:31.629 INFO 9 --- [ocp-schedules-23,aab2376a05e6695d,2b8bb6d2d84dcd64] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:52:31.636 INFO 9 --- [prometheus-minute-schedule-1,5d33dc8b986e82c5,b28f2b05e3281948] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:31.639 INFO 9 --- [prometheus-minute-schedule-1,5d33dc8b986e82c5,b28f2b05e3281948] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:31.684 INFO 9 --- [ocp-schedules-26,ae6a9e0ec93ac46e,668da40b2105fa70] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:52:31.688 INFO 9 --- [ocp-schedules-14,91e51b68de60f223,81957ac8ac4d1448] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:52:31.688 INFO 9 --- [ocp-schedules-14,91e51b68de60f223,81957ac8ac4d1448] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:52:31.689 INFO 9 --- [ocp-schedules-14,91e51b68de60f223,81957ac8ac4d1448] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:52:31.689 INFO 9 --- [ocp-schedules-14,91e51b68de60f223,81957ac8ac4d1448] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:52:31.689 INFO 9 --- [ocp-schedules-14,91e51b68de60f223,81957ac8ac4d1448] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:52:31.689 INFO 9 --- [ocp-schedules-14,91e51b68de60f223,81957ac8ac4d1448] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:52:31.751 INFO 9 --- [ocp-schedules-27,1ddeb135c5955615,6acda32131226ba3] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:52:31.752 INFO 9 --- [ocp-schedules-27,1ddeb135c5955615,6acda32131226ba3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:31.768 INFO 9 --- [ocp-schedules-27,1ddeb135c5955615,6acda32131226ba3] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:52:32.785 WARN 9 --- [ocp-async-10,90ca21e228311361,edfc1dda2c7d5eae] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:32.785 INFO 9 --- [ocp-async-7,c0a27605b4eadce2,e419fb95ee57c8cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:33.394 INFO 9 --- [ocp-schedules-25,a9727a8048a4fce9,f189e38f7ffd04c6] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:52:33.490 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:33.491 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:33.525 INFO 9 --- [ocp-schedules-15,a0f71e0a4733a099,b2a1462986080533] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:52:33.525+08:00, clusters=[1] 2025-09-16 13:52:33.526 INFO 9 --- [ocp-schedules-15,a0f71e0a4733a099,b2a1462986080533] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:52:34.086 INFO 9 --- [ocp-schedules-28,ad769b5a1e7f7d0a,73c3dbf867f6315c] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:52:34.086 INFO 9 --- [ocp-schedules-28,ad769b5a1e7f7d0a,73c3dbf867f6315c] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:52:34.086 INFO 9 --- [ocp-schedules-28,ad769b5a1e7f7d0a,73c3dbf867f6315c] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:52:34.102 INFO 9 --- [ocp-schedules-28,ad769b5a1e7f7d0a,73c3dbf867f6315c] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:52:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:52:34.603 INFO 9 --- [ocp-schedules-2,b5b5c33f405e19be,1ee29ee24dcff187] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:52:34.608 INFO 9 --- [ocp-schedules-2,b5b5c33f405e19be,1ee29ee24dcff187] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:52:34.608 INFO 9 --- [ocp-schedules-2,b5b5c33f405e19be,1ee29ee24dcff187] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:52:34.636 INFO 9 --- [prometheus-minute-schedule-1,649cd5096e1af1a7,13c6098f115f0a32] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:34.639 INFO 9 --- [prometheus-minute-schedule-1,649cd5096e1af1a7,13c6098f115f0a32] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:34.730 INFO 9 --- [ocp-schedules-22,7154d35df0f1773d,b669cb4b942aa4c0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:52:34.785 INFO 9 --- [ocp-async-4,ed74e05d810571fb,07e78c5991a1c6dd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:34.785 WARN 9 --- [ocp-async-8,29341a139050d8bf,8d3228198f6f5801] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:35.569 INFO 9 --- [ocp-schedules-18,dae29a5b00110403,37508c6d1b25ff49] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:52:35.569+08:00, clusters=[1] 2025-09-16 13:52:35.572 INFO 9 --- [ocp-schedules-18,dae29a5b00110403,37508c6d1b25ff49] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:52:36.491 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:36.491 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:36.785 INFO 9 --- [ocp-async-1,2535a0d36734c1a8,6eafc965d14becfc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:36.785 WARN 9 --- [ocp-async-2,b0841621406bcfbc,9af2c6214db96ea1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:37.636 INFO 9 --- [prometheus-minute-schedule-1,2885d67a1d0d9444,ea171a728ce8ef97] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:37.639 INFO 9 --- [prometheus-minute-schedule-1,2885d67a1d0d9444,ea171a728ce8ef97] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:37.734 INFO 9 --- [ocp-schedules-5,abe856b8ffe63908,5431a364c161a775] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:52:37.736 INFO 9 --- [ocp-schedules-5,abe856b8ffe63908,5431a364c161a775] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:37.757 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:37.757 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:52:37.770 INFO 9 --- [ocp-schedules-5,abe856b8ffe63908,5431a364c161a775] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:52:38.785 INFO 9 --- [ocp-async-6,44d5d7c2da61b382,164b7a2d1a627877] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:38.785 WARN 9 --- [ocp-async-9,63ad2b12009c8d70,07ad7b055c825fbc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:38.979 INFO 9 --- [ocp-schedules-25,27292b4cb82beb12,dfd26123325a78fc] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:52:38.981 INFO 9 --- [ocp-schedules-25,27292b4cb82beb12,dfd26123325a78fc] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:52:39.491 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:39.492 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:39.777 INFO 9 --- [ocp-schedules-3,83ef4af56d8ef6b0,fb40e4da5f577fda] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:52:39.777 INFO 9 --- [ocp-schedules-3,83ef4af56d8ef6b0,fb40e4da5f577fda] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:52:39.789 INFO 9 --- [ocp-schedules-14,2a13fdd8f1cd0bec,66f21b17ec3cad64] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:39.789 INFO 9 --- [ocp-schedules-14,2a13fdd8f1cd0bec,66f21b17ec3cad64] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:52:39.789 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:52:39.789 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:52:39.789 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:52:39.789 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:52:39.793 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:52:39.793 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:52:39.793 INFO 9 --- [ocp-schedules-14,2a13fdd8f1cd0bec,66f21b17ec3cad64] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:52:39.793 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:52:39.794 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:39.794 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:52:39.794 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:52:39.794 INFO 9 --- [ocp-schedules-14,2a13fdd8f1cd0bec,66f21b17ec3cad64] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:52:39.794 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:52:39.794 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:39.795 INFO 9 --- [Collect all tenants major compactions1,83ef4af56d8ef6b0,47dd861fa4b7cd02] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:52:39.795 INFO 9 --- [Collect all tenants major compactions2,83ef4af56d8ef6b0,a9eee8485872d26a] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:52:39.795 INFO 9 --- [Collect all tenants major compactions3,83ef4af56d8ef6b0,22398a429d6edbb6] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:52:39.808 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:52:39.808 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:52:39.809 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:52:39.809 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:52:39.809 INFO 9 --- [ocp-schedules-14,2a13fdd8f1cd0bec,66f21b17ec3cad64] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:52:39.810 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:52:39.812 INFO 9 --- [Collect all tenants major compactions1,83ef4af56d8ef6b0,47dd861fa4b7cd02] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:39.813 INFO 9 --- [Collect all tenants major compactions3,83ef4af56d8ef6b0,22398a429d6edbb6] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:39.813 INFO 9 --- [Collect all tenants major compactions2,83ef4af56d8ef6b0,a9eee8485872d26a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:39.813 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:52:39.814 INFO 9 --- [Collect all tenants major compactions3,83ef4af56d8ef6b0,22398a429d6edbb6] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:52:39.814 INFO 9 --- [Collect all tenants major compactions1,83ef4af56d8ef6b0,47dd861fa4b7cd02] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:52:39.814 INFO 9 --- [Collect all tenants major compactions2,83ef4af56d8ef6b0,a9eee8485872d26a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:52:39.814 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:52:39.818 INFO 9 --- [Collect all tenants major compactions1,83ef4af56d8ef6b0,47dd861fa4b7cd02] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:52:39.819 INFO 9 --- [Collect all tenants major compactions3,83ef4af56d8ef6b0,22398a429d6edbb6] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:52:39.819 INFO 9 --- [Collect all tenants major compactions2,83ef4af56d8ef6b0,a9eee8485872d26a] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:52:39.820 INFO 9 --- [ocp-schedules-3,83ef4af56d8ef6b0,fb40e4da5f577fda] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:52:39.827 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:52:39.829 INFO 9 --- [ocp-schedules-14,2a13fdd8f1cd0bec,66f21b17ec3cad64] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:52:40.002 INFO 9 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:52:40.002 INFO 9 --- [ocp-schedules-29,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:52:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:52:40.004043+08:00, lastProcessTime=2025-09-16T13:52:30.003517+08:00 2025-09-16 13:52:40.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:52:40.004043+08:00 2025-09-16 13:52:40.182 INFO 9 --- [ocp-async-5,5ea5a1dcb5c47e84,70392e66ca419090] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:52:40.636 INFO 9 --- [prometheus-minute-schedule-1,5e76857396088a02,40aa891da7260dec] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:40.639 INFO 9 --- [prometheus-minute-schedule-1,5e76857396088a02,40aa891da7260dec] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:40.785 INFO 9 --- [ocp-async-4,7e13fc1eeca11270,29975ae954e961bb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:40.785 WARN 9 --- [ocp-async-2,db98cec106c71531,21bd5988192d133b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:40.821 INFO 9 --- [ocp-schedules-14,bcc8890bacf21890,7238bdfe4198c658] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:52:40.826 WARN 9 --- [scanner-1373079-1,bcc8890bacf21890,acff96faa4cbf0cc] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:52:40.836 INFO 9 --- [alarm-detect-7,bcc8890bacf21890,629e2ae1bff3124c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:52:40.837 INFO 9 --- [alarm-detect-19,bcc8890bacf21890,cd68fbda44148644] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:52:40.838 INFO 9 --- [alarm-detect-11,bcc8890bacf21890,676b952a4120d0d4] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:52:40.851 INFO 9 --- [alarm-detect-7,bcc8890bacf21890,bb9c0b8cf0c752d2] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:52:42.229 INFO 9 --- [ocp-schedules-23,68e5eda2a33b5ae4,4596071a92d0d542] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:52:42.229 INFO 9 --- [ocp-schedules-23,68e5eda2a33b5ae4,4596071a92d0d542] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:52:42.262 INFO 9 --- [ocp-schedules-23,68e5eda2a33b5ae4,4596071a92d0d542] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:42.263 INFO 9 --- [ocp-schedules-23,68e5eda2a33b5ae4,4596071a92d0d542] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:52:42.492 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:42.493 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:42.785 INFO 9 --- [ocp-async-1,dea21c619e750d97,1dabdb6bd653fb4b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:42.785 WARN 9 --- [ocp-async-9,8d8c28d0385dbe3a,27da115bd974bd23] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:43.636 INFO 9 --- [prometheus-minute-schedule-1,f46af7e0407c7ae5,17b3e0d9d6db7c5f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:43.639 INFO 9 --- [prometheus-minute-schedule-1,f46af7e0407c7ae5,17b3e0d9d6db7c5f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:43.996 INFO 9 --- [ocp-schedules-15,6dc934b47ac9116c,403c8326cc485666] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:52:43.997 INFO 9 --- [ocp-schedules-15,6dc934b47ac9116c,403c8326cc485666] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:44.044 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:52:44.044 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.047 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:52:44.069 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.070 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:52:44.092 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.093 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:52:44.116 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.117 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:52:44.120 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.120 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:52:44.141 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.141 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:52:44.165 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.165 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:52:44.170 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.170 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:52:44.193 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.193 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:52:44.217 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.217 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:52:44.233 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.234 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:52:44.235 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.236 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:52:44.237 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.237 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:52:44.238 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.239 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:52:44.240 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.240 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:52:44.241 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.242 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:52:44.256 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.257 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:52:44.258 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.259 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:52:44.260 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.260 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:52:44.274 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:52:44.276 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:52:44.299 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:52:44.301 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:44.301 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:52:44.329 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:52:44.329 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:52:44.329 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:52:44.329 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:52:44.329 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:52:44.329 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:52:44.332 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:52:44.332 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:52:44.332 INFO 9 --- [ocp-schedules-15,6dc934b47ac9116c,403c8326cc485666] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:52:44.733 INFO 9 --- [ocp-schedules-24,0dadd49b3472bff7,7d7ad810d27d13e6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:52:44.785 WARN 9 --- [ocp-async-7,c13152bac1c5ffe9,2d55dc54142c43ce] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:44.785 INFO 9 --- [ocp-async-6,bff78fbc2d17f60a,7d1d060b027f77c6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:52:44,939 |-INFO in ReconfigureOnChangeTask(born:1758001784939) - Empty watch file list. Disabling 2025-09-16 13:52:45.294 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 13:52:45.294 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 13:52:45.296 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:52:45.296 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:52:45.296 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:52:45.296 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:52:45.299 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:52:45.299 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:52:45.299 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:52:45.299 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:52:45.317 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:52:45.321 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:52:45.321 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:52:45.321 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:52:45.321 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:52:45.321 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:52:45.325 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:52:45.493 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:45.494 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:45.585 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 13:52:45.872 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.572929577S 2025-09-16 13:52:45.872 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:52:45.924 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 13:52:45.924 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 13:52:45.954 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 13:52:45,966 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:52:45,967 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:52:45,967 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:52:45,967 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:52:45,968 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:52:45,968 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:52:45,966 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:52:45,967 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:52:45,967 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:52:45,967 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:52:45,968 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:52:45,968 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:52:45,968 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4adbb3df - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 13:52:45,970 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 13:52:45,970 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 13:52:45,972 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 13:52:45,972 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4adbb3df - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 13:52:45,973 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 13:52:45,973 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 13:52:45,973 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 13:52:45,973 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 13:52:45,973 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 13:52:45,974 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 13:52:45,974 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:52:45,974 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 13:52:45,975 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@241332031 - setting totalSizeCap to 10 GB 13:52:45,975 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@241332031 - Archive files will be limited to [100 MB] each. 13:52:45,975 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@241332031 - Will use gz compression 13:52:45,975 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@241332031 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 13:52:45,975 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@19307067 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 13:52:45,975 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@19307067 - Roll-over at midnight. 13:52:45,975 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@19307067 - Setting initial period to Tue Sep 16 13:52:45 CST 2025 13:52:45,975 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@241332031 - Cleaning on start up 13:52:45,975 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 13:52:45,975 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 13:52:45,976 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 13:52:45,976 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 13:52:45,976 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:52:45,976 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 13:52:45,977 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 13:52:45,977 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 13:52:45,977 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@661103649 - setting totalSizeCap to 10 GB 13:52:45,977 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@661103649 - Archive files will be limited to [100 MB] each. 13:52:45,977 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@661103649 - Will use gz compression 13:52:45,977 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@661103649 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 13:52:45,977 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ae12c65 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 13:52:45,977 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ae12c65 - Roll-over at midnight. 13:52:45,977 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@3ae12c65 - Setting initial period to Tue Sep 16 13:52:03 CST 2025 13:52:45,977 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 13:52:45,977 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 13:52:45,977 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 13:52:45,977 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 13:52:45,977 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 13:52:45,977 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 13:52:45,977 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 13:52:45,977 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 13:52:45,977 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating INFO level on Logger[ROOT] onto the JUL framework 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 13:52:45,977 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 13:52:45,977 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:52:45,978 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@2048c016 - Registering current configuration as safe fallback point 13:52:45,979 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 13:52:45,981 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating INFO level on Logger[web] onto the JUL framework 13:52:45,981 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 13:52:45,981 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@1bd1856f - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 13:52:45.982 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:52:45.982 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:52:45.983 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:52:45.983 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:52:45.983 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:52:45.983 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 13:52:45.989 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:52:46.075 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] o.s.boot.SpringApplication : Started application in 0.779 seconds (JVM running for 12941.12) 2025-09-16 13:52:46.075 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.77912697S 2025-09-16 13:52:46.324 INFO 9 --- [ocp-schedules-11,b3c26dedd38f78b7,7bb1f6676b5f1f8f] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 13:52:46.636 INFO 9 --- [prometheus-minute-schedule-1,83293cb6ca8a882b,db19487dfeef1c0d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:46.639 INFO 9 --- [prometheus-minute-schedule-1,83293cb6ca8a882b,db19487dfeef1c0d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:46.786 INFO 9 --- [ocp-async-2,dd6357eb4196c364,f3dc47b9aff46147] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:46.786 WARN 9 --- [ocp-async-3,47b55f09fb982740,bdc4d90b7eba1720] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:48.494 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:48.495 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:48.786 INFO 9 --- [ocp-async-4,25cfeb1044839bbe,a48350329454316d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:48.786 WARN 9 --- [ocp-async-5,e2925711c0394bf6,c8c6d66759e3c955] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:48.986 INFO 9 --- [ocp-schedules-5,555ca91918791f02,9c668961bc732d21] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:52:48.989 INFO 9 --- [ocp-schedules-5,555ca91918791f02,9c668961bc732d21] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:52:49.237 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.237 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:49.239 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.239 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:49.241 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:52:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:52:49.269 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:52:49.269 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:52:49.269 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:52:49.269 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:52:49.269 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:52:49.272 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.272 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.272 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.272 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.272 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.273 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:49.273 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:49.273 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:52:49.274 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:52:49.275 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.275 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:49.275 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:52:49.275 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:52:49.309 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:50:30, start=2025-09-16T13:47:30, end=2025-09-16T13:50:00, updates=70, granule=120000ms, delay=180000ms 2025-09-16 13:52:49.309 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:50:30, start=2025-09-16T13:47:30, end=2025-09-16T13:50:00, updates=77, granule=120000ms, delay=180000ms 2025-09-16 13:52:49.309 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:50:30, start=2025-09-16T13:47:30, end=2025-09-16T13:50:00, updates=138, granule=120000ms, delay=180000ms 2025-09-16 13:52:49.310 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:50:30, start=2025-09-16T13:47:30, end=2025-09-16T13:50:00, updates=107, granule=120000ms, delay=180000ms 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:50:30, target=2025-09-16T13:50:00, granule=120000ms, delay=30000ms) 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:50:30, target=2025-09-16T13:50:00, granule=120000ms, delay=30000ms) 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:50:00, target=2025-09-16T13:37:30, granule=600000ms, delay=750000ms) 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:50:00, target=2025-09-16T13:37:30, granule=600000ms, delay=750000ms) 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:50:30, target=2025-09-16T13:50:00, granule=120000ms, delay=30000ms) 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:50:30, target=2025-09-16T13:50:00, granule=120000ms, delay=30000ms) 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:50:30, start=2025-09-16T13:47:30, end=2025-09-16T13:50:00, updates=194, granule=120000ms, delay=180000ms 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:50:00, target=2025-09-16T13:37:30, granule=600000ms, delay=750000ms) 2025-09-16 13:52:49.315 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:50:00, target=2025-09-16T13:37:30, granule=600000ms, delay=750000ms) 2025-09-16 13:52:49.320 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:50:30, target=2025-09-16T13:50:00, granule=120000ms, delay=30000ms) 2025-09-16 13:52:49.320 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:50:00, target=2025-09-16T13:37:30, granule=600000ms, delay=750000ms) 2025-09-16 13:52:49.320 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=79ms, period=120000ms 2025-09-16 13:52:49.636 INFO 9 --- [prometheus-minute-schedule-1,752751647fd788b7,888383bfdbb7642f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:49.639 INFO 9 --- [prometheus-minute-schedule-1,752751647fd788b7,888383bfdbb7642f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:52:50.003642+08:00, lastProcessTime=2025-09-16T13:52:40.004043+08:00 2025-09-16 13:52:50.112 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:52:50.003642+08:00 2025-09-16 13:52:50.182 INFO 9 --- [ocp-async-3,127b38f2eedbb568,a92be0f7e867c271] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:52:50.359 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,17602e0b0ddd4276,38227308db88fe6f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=17602e0b0ddd4276, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:52:50.360 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,17602e0b0ddd4276,38227308db88fe6f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=17602e0b0ddd4276, duration=2 ms] 2025-09-16 13:52:50.786 INFO 9 --- [ocp-async-7,6459a550ca8337d1,130ad9b9656770b0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:50.786 WARN 9 --- [ocp-async-6,72e2048e8c30a876,4206217d3d353193] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:50.853 INFO 9 --- [ocp-schedules-10,2d5bd6416de041b9,3f6710c9cd9a649a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:52:50.858 WARN 9 --- [scanner-1373240-1,2d5bd6416de041b9,46fe969c6673e5cf] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:52:51.495 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:51.495 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:52.636 INFO 9 --- [prometheus-minute-schedule-1,d61505ef21564336,cd02575c43ea90be] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:52.639 INFO 9 --- [prometheus-minute-schedule-1,d61505ef21564336,cd02575c43ea90be] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:52.786 INFO 9 --- [ocp-async-3,b9947402beb2aba6,ec1e2a5bd75700af] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:52.786 WARN 9 --- [ocp-async-2,d0fd07a11cae18b2,ef36a106ddd39ff8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:54.496 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:54.496 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:54.609 INFO 9 --- [ocp-schedules-14,bacd08caefb91e66,e5e5f12f53e491c1] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:52:54.615 INFO 9 --- [ocp-schedules-14,bacd08caefb91e66,e5e5f12f53e491c1] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:52:54.615 INFO 9 --- [ocp-schedules-14,bacd08caefb91e66,e5e5f12f53e491c1] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:52:54.737 INFO 9 --- [ocp-schedules-21,f207699adaecd09c,5ad3e615e15d98ec] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:52:54.786 INFO 9 --- [ocp-async-5,d4434a02b9632633,fddda8954abdfd94] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:54.786 WARN 9 --- [ocp-async-4,d27dda98ba2d91a8,23a43c7f4cf57feb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:55.636 INFO 9 --- [prometheus-minute-schedule-1,27280201d5ce1776,1a912104038965e3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:55.639 INFO 9 --- [prometheus-minute-schedule-1,27280201d5ce1776,1a912104038965e3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:56.786 INFO 9 --- [ocp-async-1,ceb636eb494692b9,51936ff6c651ab3a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:56.786 WARN 9 --- [ocp-async-10,2be7a143ae39b97f,334eca3908f75707] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:57.496 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:52:57.497 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:52:58.636 INFO 9 --- [prometheus-minute-schedule-1,2000c0c85db23568,35bd566cc600d3a9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758001980, interval=60 2025-09-16 13:52:58.639 INFO 9 --- [prometheus-minute-schedule-1,2000c0c85db23568,35bd566cc600d3a9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:52:58.786 INFO 9 --- [ocp-async-2,31ad046373a4187e,9c5bb91aca352414] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:52:58.786 WARN 9 --- [ocp-async-8,0d9982e6b3c864e9,ee56fa5c5456e716] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:52:58.993 INFO 9 --- [ocp-schedules-29,6007300f7fc5ecdc,6aabf9b8774861fe] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:52:58.995 INFO 9 --- [ocp-schedules-29,6007300f7fc5ecdc,6aabf9b8774861fe] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:52:59.938 INFO 9 --- [ocp-schedules-7,34163ce8037def5c,1e7a9132cfdafe5b] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:52:59.941 INFO 9 --- [ocp-schedules-5,281876952bf32813,fadf1e7d2cd65a79] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:52:59.941 INFO 9 --- [ocp-schedules-3,f85f396136d27c05,4213758b19587c12] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:52:59.942 INFO 9 --- [ocp-schedules-9,88e0e7f7fcb768ca,16483f5a0e16d4f1] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:52:59.942 INFO 9 --- [ocp-schedules-3,f85f396136d27c05,4213758b19587c12] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:59.943 INFO 9 --- [ocp-schedules-5,281876952bf32813,fadf1e7d2cd65a79] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:59.944 INFO 9 --- [ocp-schedules-9,88e0e7f7fcb768ca,16483f5a0e16d4f1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:52:59.944 INFO 9 --- [ocp-schedules-9,88e0e7f7fcb768ca,16483f5a0e16d4f1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:52:59.944 INFO 9 --- [ocp-schedules-25,f7d7f7bd2de6a62a,e8a8280c8d8d3c9e] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:59.944 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:52:59.944 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:52:59.945 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:52:59.945 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:52:59.945 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:52:59.945 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:52:59.945 INFO 9 --- [ocp-schedules-11,f9cbd070845722b1,5db7f16d0ce748f7] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:59.945 INFO 9 --- [ocp-schedules-19,c7e432dffe0b9bb9,62c25432da234fed] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:52:59.945 INFO 9 --- [host-check-clockdiff1,f9cbd070845722b1,7e6ba643f6b3da25] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:52:59.945 INFO 9 --- [host-check-agent-status1,c7e432dffe0b9bb9,d41284a44b25e66b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:52:59.945 INFO 9 --- [host-check-clockdiff2,f9cbd070845722b1,50aab6f78a7205e9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:52:59.945 INFO 9 --- [host-check-agent-status2,c7e432dffe0b9bb9,6d3b88ea3e7856bf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:52:59.945 INFO 9 --- [host-check-clockdiff3,f9cbd070845722b1,f52331d7670f43ae] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:52:59.946 INFO 9 --- [host-check-agent-status3,c7e432dffe0b9bb9,5372808bfa457394] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:52:59.946 INFO 9 --- [host-check-clockdiff4,f9cbd070845722b1,c598b835cc89b182] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:52:59.946 INFO 9 --- [host-check-agent-status4,c7e432dffe0b9bb9,55877a875da50671] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:52:59.946 INFO 9 --- [host-check-agent-status5,c7e432dffe0b9bb9,386256c757e6363e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:52:59.946 INFO 9 --- [host-check-agent-status6,c7e432dffe0b9bb9,46ad40ed197ffdaf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:52:59.946 INFO 9 --- [host-check-clockdiff5,f9cbd070845722b1,b96ccf3ee082297d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:52:59.946 INFO 9 --- [host-check-clockdiff6,f9cbd070845722b1,411993816b50b23b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:52:59.947 INFO 9 --- [ocp-schedules-17,b63fc2e2540d2792,378163a6836b1289] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:52:59.951 INFO 9 --- [host-check-clockdiff3,f9cbd070845722b1,f52331d7670f43ae] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001979 -1 -1 , error= 2025-09-16 13:52:59.951 INFO 9 --- [host-check-clockdiff5,f9cbd070845722b1,b96ccf3ee082297d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001979 -1 -1 , error= 2025-09-16 13:52:59.951 INFO 9 --- [host-check-clockdiff2,f9cbd070845722b1,50aab6f78a7205e9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001979 -2 -2 , error= 2025-09-16 13:52:59.953 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:52:59.953 INFO 9 --- [host-check-clockdiff4,f9cbd070845722b1,c598b835cc89b182] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001979 -1 -1 , error= 2025-09-16 13:52:59.953 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:52:59.954 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:52:59.954 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:52:59.954 INFO 9 --- [host-check-clockdiff6,f9cbd070845722b1,411993816b50b23b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001979 -1 -1 , error= 2025-09-16 13:52:59.954 INFO 9 --- [host-check-agent-status1,c7e432dffe0b9bb9,d41284a44b25e66b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:52:59.954 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:52:59.954 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:59.954 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:52:59.955 INFO 9 --- [host-check-agent-status3,c7e432dffe0b9bb9,5372808bfa457394] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:52:59.955 INFO 9 --- [host-check-agent-status4,c7e432dffe0b9bb9,55877a875da50671] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:52:59.955 INFO 9 --- [host-check-agent-status6,c7e432dffe0b9bb9,46ad40ed197ffdaf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:59.955 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:52:59.955 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:52:59.955 INFO 9 --- [host-check-agent-status1,c7e432dffe0b9bb9,d41284a44b25e66b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:52:59.955 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:52:59.955 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:59.955 INFO 9 --- [host-check-agent-status3,c7e432dffe0b9bb9,5372808bfa457394] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:52:59.955 INFO 9 --- [host-check-agent-status2,c7e432dffe0b9bb9,6d3b88ea3e7856bf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:52:59.956 INFO 9 --- [host-check-agent-status6,c7e432dffe0b9bb9,46ad40ed197ffdaf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:59.956 INFO 9 --- [host-check-agent-status4,c7e432dffe0b9bb9,55877a875da50671] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:52:59.956 INFO 9 --- [host-check-agent-status5,c7e432dffe0b9bb9,386256c757e6363e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:52:59.956 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:52:59.956 INFO 9 --- [host-check-agent-status2,c7e432dffe0b9bb9,6d3b88ea3e7856bf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:52:59.957 INFO 9 --- [host-check-agent-status5,c7e432dffe0b9bb9,386256c757e6363e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:52:59.969 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:52:59.970 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:52:59.970 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:52:59.970 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:52:59.970 INFO 9 --- [host-check-agent-status1,c7e432dffe0b9bb9,d41284a44b25e66b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:52:59.970 INFO 9 --- [host-check-agent-status3,c7e432dffe0b9bb9,5372808bfa457394] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:52:59.970 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:52:59.971 INFO 9 --- [host-check-agent-status4,c7e432dffe0b9bb9,55877a875da50671] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:52:59.971 INFO 9 --- [host-check-agent-status6,c7e432dffe0b9bb9,46ad40ed197ffdaf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:52:59.971 INFO 9 --- [host-check-agent-status2,c7e432dffe0b9bb9,6d3b88ea3e7856bf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:52:59.971 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:52:59.970345916+08:00 2025-09-16 13:52:59.971 INFO 9 --- [host-check-agent-status5,c7e432dffe0b9bb9,386256c757e6363e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:52:59.971 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:52:59.970195019+08:00 2025-09-16 13:52:59.971 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:52:59.970402601+08:00 2025-09-16 13:52:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:52:59.971+08:00 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:52:59.971+08:00 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:52:59.971154446+08:00 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:52:59.971+08:00 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:52:59.971199148+08:00 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:52:59.972+08:00 2025-09-16 13:52:59.972 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:52:59.972+08:00 2025-09-16 13:52:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:52:59.974 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:52:59.972669892+08:00 2025-09-16 13:52:59.974 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:52:59.974+08:00 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status3,c7e432dffe0b9bb9,5372808bfa457394] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status3,c7e432dffe0b9bb9,5372808bfa457394] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status3,c7e432dffe0b9bb9,5372808bfa457394] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status6,c7e432dffe0b9bb9,46ad40ed197ffdaf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status6,c7e432dffe0b9bb9,46ad40ed197ffdaf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status6,c7e432dffe0b9bb9,46ad40ed197ffdaf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status2,c7e432dffe0b9bb9,6d3b88ea3e7856bf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status2,c7e432dffe0b9bb9,6d3b88ea3e7856bf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:52:59.974 INFO 9 --- [host-check-agent-status2,c7e432dffe0b9bb9,6d3b88ea3e7856bf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:52:59.975 INFO 9 --- [host-check-agent-status1,c7e432dffe0b9bb9,d41284a44b25e66b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:52:59.975 INFO 9 --- [host-check-agent-status1,c7e432dffe0b9bb9,d41284a44b25e66b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:52:59.975 INFO 9 --- [host-check-agent-status1,c7e432dffe0b9bb9,d41284a44b25e66b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:52:59.975 INFO 9 --- [host-check-agent-status4,c7e432dffe0b9bb9,55877a875da50671] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:52:59.975 INFO 9 --- [host-check-agent-status4,c7e432dffe0b9bb9,55877a875da50671] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:52:59.975 INFO 9 --- [host-check-agent-status4,c7e432dffe0b9bb9,55877a875da50671] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:52:59.976 INFO 9 --- [host-check-agent-status5,c7e432dffe0b9bb9,386256c757e6363e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:52:59.976 INFO 9 --- [host-check-agent-status5,c7e432dffe0b9bb9,386256c757e6363e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:52:59.976 INFO 9 --- [host-check-agent-status5,c7e432dffe0b9bb9,386256c757e6363e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:52:59.978 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:52:59.971+08:00 and status AVAILABLE 2025-09-16 13:52:59.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:52:59.978 INFO 9 --- [ocp-schedules-3,f85f396136d27c05,4213758b19587c12] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:52:59.979 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:52:59.972+08:00 and status AVAILABLE 2025-09-16 13:52:59.980 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:52:59.981 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:52:59.972+08:00 and status AVAILABLE 2025-09-16 13:52:59.982 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:52:59.971+08:00 and status AVAILABLE 2025-09-16 13:52:59.982 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:52:59.982 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:52:59.971+08:00 and status AVAILABLE 2025-09-16 13:52:59.983 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:52:59.984 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:52:59.974+08:00 and status AVAILABLE 2025-09-16 13:52:59.985 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:52:59.986 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:52:59.986 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:52:59.986 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:52:59.987 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:52:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:52:59.987 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:52:59.988 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:52:59.988 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:52:59.989 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:52:59.989 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:52:59.991 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:52:59.992 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:52:59.992 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:52:59.993 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:52:59.993 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:52:59.993 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:00.003 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:00.003 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:00.004 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:00.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:53:00.003890+08:00, lastProcessTime=2025-09-16T13:52:50.003642+08:00 2025-09-16 13:53:00.007 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:00.007 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:00.007 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:00.030 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:53:00.033 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:53:00.035 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:53:00.035 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:53:00.036 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:53:00.036 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:53:00.037 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:53:00.037 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:00.039 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:53:00.041 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:00.041 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:53:00.041 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:53:00.041 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:53:00.042 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:53:00.043 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:53:00.054 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:00.055 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:00.055 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:00.055 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:00.055 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:00.056 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:00.076 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:00.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:00.078 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:53:00.082 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:53:00.083 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:53:00.083 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:53:00.083 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:53:00.084 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:53:00.084 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:00.085 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:53:00.086 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:53:00.088 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:00.089 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:53:00.090 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:53:00.090 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:53:00.090 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:53:00.091 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:53:00.092 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:53:00.102 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:00.102 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:00.103 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:00.103 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:00.103 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:00.104 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:00.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:00.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:00.130 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:53:00.130 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:53:00.131 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:53:00.131 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:53:00.131 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:53:00.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:53:00.003890+08:00 2025-09-16 13:53:00.132 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:53:00.137 INFO 9 --- [host-check-host-status2,f7d7f7bd2de6a62a,8429f8938a7d651b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:53:00.137 INFO 9 --- [host-check-host-status5,f7d7f7bd2de6a62a,828adabf743eeffd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:53:00.137 INFO 9 --- [host-check-host-status1,f7d7f7bd2de6a62a,3a5bf96773c8742c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:53:00.138 INFO 9 --- [host-check-host-status4,f7d7f7bd2de6a62a,b88d8853310f8870] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:53:00.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:00.138 INFO 9 --- [host-check-host-status3,f7d7f7bd2de6a62a,c44088a32460470a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:53:00.139 INFO 9 --- [host-check-host-status6,f7d7f7bd2de6a62a,e91c4fb8b0bed9c1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:53:00.154 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:00.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:00.182 INFO 9 --- [ocp-async-10,4200a72c81886db8,8a5126e1e86288da] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:53:00.188 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.188 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:00.202 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.202 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:00.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:00.247 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:00.259 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:00.260 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:00.261 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:53:00.266 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:53:00.269 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:53:00.271 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:00.272 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:00.284 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:53:00.350 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:53:00.363 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:00.367 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:00.368 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:53:00.381 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:53:00.381 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:53:00.381 INFO 9 --- [ocp-schedules-5,281876952bf32813,fadf1e7d2cd65a79] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:53:00.497 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:00.498 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:00.786 INFO 9 --- [ocp-async-4,a973724c18d93c4c,621e1e6fbecda561] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:00.786 WARN 9 --- [ocp-async-5,2660ac7883388903,9ceaa28159a80d8e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:00.840 INFO 9 --- [ocp-schedules-21,8147bef21ee02d18,6cd91d95c4fa356e] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:53:00.879 INFO 9 --- [ocp-schedules-17,bb58c8a2824bbe81,f592be68cf08b0ae] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:53:00.886 INFO 9 --- [host-check-clockdiff1,f9cbd070845722b1,7e6ba643f6b3da25] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758001980 -1 -1 , error= 2025-09-16 13:53:00.887 WARN 9 --- [scanner-1373370-1,bb58c8a2824bbe81,91e5602ce85177ce] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:53:00.897 INFO 9 --- [alarm-detect-13,bb58c8a2824bbe81,3709b2f2d9338e85] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:53:00.899 INFO 9 --- [alarm-detect-10,bb58c8a2824bbe81,9a294de7e55d1282] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:53:00.899 INFO 9 --- [alarm-detect-8,bb58c8a2824bbe81,ae86cfd590494f15] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:53:00.912 INFO 9 --- [alarm-detect-17,bb58c8a2824bbe81,a8680f354827e79f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:53:01.636 INFO 9 --- [prometheus-minute-schedule-1,f3a149a84c6e6d27,3cf6979462a2fd13] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:01.643 INFO 9 --- [prometheus-minute-schedule-1,f3a149a84c6e6d27,3cf6979462a2fd13] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:02.787 WARN 9 --- [ocp-async-1,e3ac22ad758bf42a,5487395c4aab6535] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:02.787 INFO 9 --- [ocp-async-6,b1faa9d00595f691,fc7bf55e32f0b4d4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:03.498 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:03.499 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:04.636 INFO 9 --- [prometheus-minute-schedule-1,3ce3686cf4e03ff0,32be5d5726d04bf2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:04.640 INFO 9 --- [prometheus-minute-schedule-1,3ce3686cf4e03ff0,32be5d5726d04bf2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:04.740 INFO 9 --- [ocp-schedules-27,8085e8866177bd12,78827f59d49ac5b3] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:53:04.787 INFO 9 --- [ocp-async-7,82453a30c1d937f8,6bc73e94336e269f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:04.787 WARN 9 --- [ocp-async-2,7d3d8a5054f6ec88,50298aa426876f4a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:06.499 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:06.500 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:06.787 WARN 9 --- [ocp-async-9,5206337f803fedfd,c6e08ee2c9eb0784] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:06.787 INFO 9 --- [ocp-async-5,9ab0511bc0ad0fec,1f71d661ac4c42c5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:07.636 INFO 9 --- [prometheus-minute-schedule-1,e0b61c1233695e97,3ef450e6b5ca5a70] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:07.639 INFO 9 --- [prometheus-minute-schedule-1,e0b61c1233695e97,3ef450e6b5ca5a70] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:08.787 INFO 9 --- [ocp-async-1,2f004e0120ac629c,2a56680ecc3be25e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:08.787 WARN 9 --- [ocp-async-10,006a6841c419267f,82e1617a3e46d630] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:09.000 INFO 9 --- [ocp-schedules-8,201fe13ec722d5a9,fa71207ff6775359] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:53:09.002 INFO 9 --- [ocp-schedules-8,201fe13ec722d5a9,fa71207ff6775359] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:53:09.500 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:09.500 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:10.002 INFO 9 --- [ocp-schedules-15,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:53:10.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:53:10.003105+08:00, lastProcessTime=2025-09-16T13:53:00.003890+08:00 2025-09-16 13:53:10.007 INFO 9 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:53:10.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:53:10.003105+08:00 2025-09-16 13:53:10.183 INFO 9 --- [ocp-async-9,04e413b91b1548f3,dc7c5df7a87a55a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:53:10.298 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:53:10.636 INFO 9 --- [prometheus-minute-schedule-1,864fe1416f8060e9,a28a14d02f460441] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:10.639 INFO 9 --- [prometheus-minute-schedule-1,864fe1416f8060e9,a28a14d02f460441] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:10.787 WARN 9 --- [ocp-async-8,20677b449e989272,6bce0e22d9cab936] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:10.787 INFO 9 --- [ocp-async-7,339d7b0c30c35c1a,cf8b10cd2d700a8f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:10.915 INFO 9 --- [ocp-schedules-2,a788b88a22e7284a,f60efe7054f0da9f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:53:10.920 WARN 9 --- [scanner-1373543-1,a788b88a22e7284a,42e8281b96bcd8bb] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:53:11.726 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001920, nodeCount=463, affectRows=463 2025-09-16 13:53:12.500 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:12.501 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:12.787 WARN 9 --- [ocp-async-3,d6c90afe120295ea,007f32c66229eff8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:12.787 INFO 9 --- [ocp-async-5,4bec739734d4f737,6ed924861345f0f5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:13.636 INFO 9 --- [prometheus-minute-schedule-1,13f344c42c71d229,14b1ed635a64efca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:13.639 INFO 9 --- [prometheus-minute-schedule-1,13f344c42c71d229,14b1ed635a64efca] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:14.346 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001920, nodeCount=1000, affectRows=1000 2025-09-16 13:53:14.349 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001920, nodeCount=1000, validCount=996 2025-09-16 13:53:14.374 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001920, nodeCount=1000, affectRows=1000 2025-09-16 13:53:14.377 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001920, nodeCount=1000, validCount=998 2025-09-16 13:53:14.388 ERROR 9 --- [metric-archive-second-2,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221684167) Duplicate entry '824401952599621632-1758001860' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221684167) Duplicate entry '824401952599621632-1758001860' for key 'PRIMARY' 2025-09-16 13:53:14.622 INFO 9 --- [ocp-schedules-13,ce63d9a29cc3c323,3a8eac0476cd25c5] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:53:14.635 INFO 9 --- [ocp-schedules-13,ce63d9a29cc3c323,3a8eac0476cd25c5] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:53:14.635 INFO 9 --- [ocp-schedules-13,ce63d9a29cc3c323,3a8eac0476cd25c5] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:53:14.744 INFO 9 --- [ocp-schedules-20,69c18cb58159a8ad,4e188fe1d48dfe3b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:53:14.787 WARN 9 --- [ocp-async-10,f821d4aeebdad879,2e1a602f2c77e0d9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:14.787 INFO 9 --- [ocp-async-1,00d08558b2ad1a02,1eb7cfcd09f35db4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:15.465 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697862) Duplicate entry '824401952549289984-1758001860' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697862) Duplicate entry '824401952549289984-1758001860' for key 'PRIMARY' 2025-09-16 13:53:15.468 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001920, nodeCount=124, affectRows=124 2025-09-16 13:53:15.469 ERROR 9 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952457015296-1758001860' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952457015296-1758001860' for key 'PRIMARY' 2025-09-16 13:53:15.469 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001920, nodeCount=124, validCount=124 2025-09-16 13:53:15.501 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:15.502 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:15.824 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001920, nodeCount=1000, affectRows=1000 2025-09-16 13:53:15.826 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001920, nodeCount=991, validCount=957 2025-09-16 13:53:16.066 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001920, nodeCount=347, affectRows=347 2025-09-16 13:53:16.066 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001920, nodeCount=347, validCount=341 2025-09-16 13:53:16.100 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001920, nodeCount=382, affectRows=382 2025-09-16 13:53:16.101 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001920, nodeCount=382, validCount=374 2025-09-16 13:53:16.636 INFO 9 --- [prometheus-minute-schedule-1,2351ca1ce5aba853,5651a60b0c7ae0a1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:16.639 INFO 9 --- [prometheus-minute-schedule-1,2351ca1ce5aba853,5651a60b0c7ae0a1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:16.787 WARN 9 --- [ocp-async-6,8cb1be3c0999934b,c6e0ade9d7c90cfc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:16.787 INFO 9 --- [ocp-async-2,393eabe3e0175178,e5bede84792f09ba] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:18.502 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:18.502 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:18.788 WARN 9 --- [ocp-async-7,882a897c9dbd2b74,caf7f32a90aea6fb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:18.788 INFO 9 --- [ocp-async-9,a9b19450cd370a22,b33f385835b9bacd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:19.006 INFO 9 --- [ocp-schedules-8,b2a1a4ade3a00382,729f9c5a4dd09fbb] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:53:19.008 INFO 9 --- [ocp-schedules-8,b2a1a4ade3a00382,729f9c5a4dd09fbb] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:53:19.636 INFO 9 --- [prometheus-minute-schedule-1,ea8617e035bb981c,6b2168b845cf793d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:19.639 INFO 9 --- [prometheus-minute-schedule-1,ea8617e035bb981c,6b2168b845cf793d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:53:20.003405+08:00, lastProcessTime=2025-09-16T13:53:10.003105+08:00 2025-09-16 13:53:20.115 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:53:20.003405+08:00 2025-09-16 13:53:20.183 INFO 9 --- [ocp-async-6,692efbac3db8c839,a8da10cf1c79bd6e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:53:20.636 INFO 9 --- [prometheus-cache-monitor1,7aacbac07b8b9030,1926ca2064d4cb58] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:53:20.636 INFO 9 --- [prometheus-cache-monitor1,7aacbac07b8b9030,1926ca2064d4cb58] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:53:20.788 WARN 9 --- [ocp-async-10,a2fa88ce9700b30f,66640974b0338cbb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:20.788 INFO 9 --- [ocp-async-1,66fd5aabd58e8517,266ea9ff9c56987d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:20.945 INFO 9 --- [ocp-schedules-24,97d8fb0dd9a07844,dddeb518bbc5333a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:53:20.950 WARN 9 --- [scanner-1374537-1,97d8fb0dd9a07844,ccc01158909fed08] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:53:20.961 INFO 9 --- [alarm-detect-16,97d8fb0dd9a07844,cae3c405c227cb04] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:53:20.962 INFO 9 --- [alarm-detect-8,97d8fb0dd9a07844,02536248fd0b1ffe] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:53:20.962 INFO 9 --- [alarm-detect-12,97d8fb0dd9a07844,155664d99df3b9a6] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:53:20.975 INFO 9 --- [alarm-detect-20,97d8fb0dd9a07844,f0ddf1f7687cc7e6] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:53:21.502 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:21.503 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:22.636 INFO 9 --- [prometheus-minute-schedule-1,8c37bdf26b0b4fa9,82dee76eb9962348] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:22.639 INFO 9 --- [prometheus-minute-schedule-1,8c37bdf26b0b4fa9,82dee76eb9962348] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:22.788 WARN 9 --- [ocp-async-6,72e5aa343b161ec5,f1e636b7def1451d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:22.788 INFO 9 --- [ocp-async-2,237597250cf3ab84,0a3f05e393eb0293] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:24.503 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:24.504 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:24.747 INFO 9 --- [ocp-schedules-2,59ae3f14f1fb830d,3e50b7eacbed844c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:53:24.788 WARN 9 --- [ocp-async-7,cb16962bf2ce554f,418368922149d9e9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:24.788 INFO 9 --- [ocp-async-7,2f18b92d6aef8345,15d0ebfd258667d4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:25.636 INFO 9 --- [prometheus-minute-schedule-1,f05c421dc8602d92,f2b81cf96cf3396c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:25.639 INFO 9 --- [prometheus-minute-schedule-1,f05c421dc8602d92,f2b81cf96cf3396c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:26.788 WARN 9 --- [ocp-async-5,678e43ede50854d4,a6e37ff1bfc50008] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:26.788 INFO 9 --- [ocp-async-4,e7143524d9796539,bce50b53e10f2283] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:27.504 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:27.504 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:28.636 INFO 9 --- [prometheus-minute-schedule-1,eb49981097b1cd15,12bb65ebeb25694a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:28.639 INFO 9 --- [prometheus-minute-schedule-1,eb49981097b1cd15,12bb65ebeb25694a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:28.788 WARN 9 --- [ocp-async-1,e2750782f9f1d6c5,aa0dd90e42f9ca27] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:28.788 INFO 9 --- [ocp-async-8,af5157b62e986c74,481b8038513efd2e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:29.013 INFO 9 --- [ocp-schedules-12,49e76586a688211f,1a6152b9fd0143c6] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:53:29.015 INFO 9 --- [ocp-schedules-12,49e76586a688211f,1a6152b9fd0143c6] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:53:29.938 INFO 9 --- [ocp-schedules-30,0a78259452c299cd,eb26c36decbb43ef] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:53:29.941 INFO 9 --- [ocp-schedules-30,1bdddb3e42e7e188,08a337cc744433fa] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:53:29.941 INFO 9 --- [ocp-schedules-15,c83d818332ca97b6,ca80e37bdc1370a9] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:53:29.942 INFO 9 --- [ocp-schedules-27,5f763e69df7677cf,10a105b6959e44c3] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:53:29.942 INFO 9 --- [ocp-schedules-30,1bdddb3e42e7e188,08a337cc744433fa] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:29.943 INFO 9 --- [ocp-schedules-15,c83d818332ca97b6,ca80e37bdc1370a9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:29.944 INFO 9 --- [ocp-schedules-27,5f763e69df7677cf,10a105b6959e44c3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:29.944 INFO 9 --- [ocp-schedules-27,5f763e69df7677cf,10a105b6959e44c3] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:53:29.945 INFO 9 --- [ocp-schedules-13,d0701f3bf06c0553,01833596dac11f13] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:53:29.945 INFO 9 --- [ocp-schedules-16,f65e1159144f31cd,bfa33d4ebaa1bf00] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:53:29.945 INFO 9 --- [host-check-clockdiff1,f65e1159144f31cd,8698a111ca7bbc01] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:53:29.945 INFO 9 --- [host-check-agent-status1,d0701f3bf06c0553,d35d23248153c724] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:53:29.946 INFO 9 --- [host-check-agent-status2,d0701f3bf06c0553,0714b5c7ae4f30eb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:53:29.946 INFO 9 --- [host-check-clockdiff2,f65e1159144f31cd,62439f4c61ac41f2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:53:29.946 INFO 9 --- [host-check-agent-status3,d0701f3bf06c0553,7c16ae48d95bedb9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:53:29.946 INFO 9 --- [host-check-clockdiff3,f65e1159144f31cd,caeedd3aba5f33a1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:53:29.946 INFO 9 --- [host-check-clockdiff4,f65e1159144f31cd,10971949f14dd631] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:53:29.946 INFO 9 --- [host-check-agent-status4,d0701f3bf06c0553,76711eff1f088385] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:53:29.946 INFO 9 --- [host-check-clockdiff5,f65e1159144f31cd,86b4c60f52e53cc2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:53:29.946 INFO 9 --- [host-check-agent-status5,d0701f3bf06c0553,21544adac039afaf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:53:29.946 INFO 9 --- [host-check-agent-status6,d0701f3bf06c0553,18a3faae8740b36c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:53:29.946 INFO 9 --- [host-check-clockdiff6,f65e1159144f31cd,f549e53bf8e88411] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:53:29.951 INFO 9 --- [host-check-clockdiff2,f65e1159144f31cd,62439f4c61ac41f2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002009 -2 -2 , error= 2025-09-16 13:53:29.951 INFO 9 --- [ocp-schedules-6,c2abf327c3aad26e,3ac4ac0d3cc85a1a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:53:29.952 INFO 9 --- [host-check-clockdiff1,f65e1159144f31cd,8698a111ca7bbc01] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002009 -1 -1 , error= 2025-09-16 13:53:29.954 INFO 9 --- [ocp-schedules-1,1e38a03cf4d1d6fa,b2ddb850a1862759] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2025-09-16 13:53:29.954 INFO 9 --- [host-check-clockdiff4,f65e1159144f31cd,10971949f14dd631] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002009 -1 -1 , error= 2025-09-16 13:53:29.954 INFO 9 --- [host-check-clockdiff3,f65e1159144f31cd,caeedd3aba5f33a1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002009 -1 -1 , error= 2025-09-16 13:53:29.954 INFO 9 --- [host-check-clockdiff5,f65e1159144f31cd,86b4c60f52e53cc2] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002009 -1 -1 , error= 2025-09-16 13:53:29.955 INFO 9 --- [host-check-agent-status4,d0701f3bf06c0553,76711eff1f088385] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:29.955 INFO 9 --- [host-check-agent-status2,d0701f3bf06c0553,0714b5c7ae4f30eb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:29.955 INFO 9 --- [host-check-agent-status5,d0701f3bf06c0553,21544adac039afaf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:29.955 INFO 9 --- [host-check-agent-status3,d0701f3bf06c0553,7c16ae48d95bedb9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:29.955 INFO 9 --- [host-check-agent-status6,d0701f3bf06c0553,18a3faae8740b36c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:29.955 INFO 9 --- [ocp-schedules-1,1e38a03cf4d1d6fa,b2ddb850a1862759] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:29.956 INFO 9 --- [host-check-agent-status5,d0701f3bf06c0553,21544adac039afaf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:29.956 INFO 9 --- [host-check-agent-status2,d0701f3bf06c0553,0714b5c7ae4f30eb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:29.956 INFO 9 --- [host-check-agent-status3,d0701f3bf06c0553,7c16ae48d95bedb9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:29.956 INFO 9 --- [host-check-agent-status6,d0701f3bf06c0553,18a3faae8740b36c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:29.960 INFO 9 --- [host-check-agent-status4,d0701f3bf06c0553,76711eff1f088385] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:29.962 INFO 9 --- [ocp-schedules-28,88b9e58de467bdae,6db3008a8f5dbba1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:53:29.963 INFO 9 --- [ocp-schedules-19,f2ee726b4663a4a2,367b2d90d15e5b0e] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:53:29.968 INFO 9 --- [ocp-schedules-28,88b9e58de467bdae,6db3008a8f5dbba1] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:53:29.969 INFO 9 --- [ocp-schedules-19,f2ee726b4663a4a2,367b2d90d15e5b0e] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:53:29.970 INFO 9 --- [host-check-agent-status6,d0701f3bf06c0553,18a3faae8740b36c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:53:29.971 INFO 9 --- [host-check-agent-status5,d0701f3bf06c0553,21544adac039afaf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:53:29.971 INFO 9 --- [ocp-schedules-12,084d45666352bc6e,e8426f0c81102b52] c.o.o.s.common.scheduled.OcpSchedules : Cleanup ocp connection pools. 2025-09-16 13:53:29.971 INFO 9 --- [ocp-schedules-12,084d45666352bc6e,e8426f0c81102b52] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2025-09-16 13:53:29.972 INFO 9 --- [host-check-agent-status1,d0701f3bf06c0553,d35d23248153c724] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:29.973 INFO 9 --- [host-check-agent-status1,d0701f3bf06c0553,d35d23248153c724] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:29.975 INFO 9 --- [ocp-schedules-10,dbece03ccc469003,cab4b5339ef17dd6] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:53:29.975 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:53:29.975 INFO 9 --- [host-check-agent-status6,d0701f3bf06c0553,18a3faae8740b36c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:53:29.975 INFO 9 --- [host-check-agent-status6,d0701f3bf06c0553,18a3faae8740b36c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:53:29.975 INFO 9 --- [host-check-agent-status6,d0701f3bf06c0553,18a3faae8740b36c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:53:29.975 INFO 9 --- [host-check-agent-status5,d0701f3bf06c0553,21544adac039afaf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:53:29.975 INFO 9 --- [host-check-agent-status5,d0701f3bf06c0553,21544adac039afaf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:53:29.975 INFO 9 --- [host-check-agent-status5,d0701f3bf06c0553,21544adac039afaf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:53:29.975 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:53:29.975 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:53:29.975 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:53:29.975 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:53:29.975 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:53:29.975 INFO 9 --- [host-check-agent-status2,d0701f3bf06c0553,0714b5c7ae4f30eb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:53:29.976 INFO 9 --- [host-check-agent-status4,d0701f3bf06c0553,76711eff1f088385] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:53:29.978 INFO 9 --- [pool-overview-container-8,87f316c79a33be93,7e229d84fbe53924] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:53:29.978 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:29.978 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:29.978 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:29.978 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:29.979 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:29.979 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:29.979 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:29.979 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:29.979 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:29.979 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:29.979 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:29.980 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:29.980 INFO 9 --- [host-check-agent-status2,d0701f3bf06c0553,0714b5c7ae4f30eb] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:53:29.980 INFO 9 --- [host-check-agent-status2,d0701f3bf06c0553,0714b5c7ae4f30eb] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:53:29.980 INFO 9 --- [host-check-agent-status2,d0701f3bf06c0553,0714b5c7ae4f30eb] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:53:29.980 INFO 9 --- [host-check-agent-status4,d0701f3bf06c0553,76711eff1f088385] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:53:29.980 INFO 9 --- [host-check-agent-status4,d0701f3bf06c0553,76711eff1f088385] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:53:29.980 INFO 9 --- [host-check-agent-status4,d0701f3bf06c0553,76711eff1f088385] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:53:29.980 INFO 9 --- [pool-overview-container-4,9bc74d179a6025a8,4f16de64510085b5] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:53:29.981 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:29.982 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2025-09-16 13:53:29.986 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:29.987 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:53:29.989 INFO 9 --- [host-check-agent-status1,d0701f3bf06c0553,d35d23248153c724] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:53:29.993 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:53:29.993 INFO 9 --- [ocp-schedules-15,c83d818332ca97b6,ca80e37bdc1370a9] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:53:29.993 INFO 9 --- [host-check-agent-status1,d0701f3bf06c0553,d35d23248153c724] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:53:29.993 INFO 9 --- [host-check-agent-status1,d0701f3bf06c0553,d35d23248153c724] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:53:29.993 INFO 9 --- [host-check-agent-status1,d0701f3bf06c0553,d35d23248153c724] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:53:29.994 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:53:29.994 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:53:29.994 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:53:29.993474350+08:00 2025-09-16 13:53:29.994 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:53:29.994 INFO 9 --- [pool-12-thread-15,87f316c79a33be93,b1ce98e0c6d3569f] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get outline history 2025-09-16 13:53:29.994 INFO 9 --- [pool-12-thread-13,87f316c79a33be93,5851a37607d78345] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get Cluster Sql Stat 2025-09-16 13:53:29.994 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:53:29.994 INFO 9 --- [pool-12-thread-13,87f316c79a33be93,5851a37607d78345] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster slow Sql Stat 2025-09-16 13:53:29.994 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:53:29.994 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:53:29.994+08:00 2025-09-16 13:53:29.995 INFO 9 --- [pool-12-thread-16,87f316c79a33be93,8f34a5e2ca9af9bb] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster session stat 2025-09-16 13:53:29.995 INFO 9 --- [pool-12-thread-14,87f316c79a33be93,78a4410b99df4400] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to get cluster trans stat 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:53:29.993487202+08:00 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:53:29.993852944+08:00 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:53:29.994013863+08:00 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:53:29.995+08:00 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:53:29.995+08:00 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:53:29.994691063+08:00 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:53:29.995+08:00 2025-09-16 13:53:29.995 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:53:29.994353904+08:00 2025-09-16 13:53:29.996 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ae042c46d9e537fb,8f0c3b944bb35cfc] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=zhengqi&ObClusterId=1&version=2, client=10.232.140.0, traceId=ae042c46d9e537fb, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getRootServiceInfo(String,Long,String,Long,boolean,Integer), args=zhengqi,1,false,2,] 2025-09-16 13:53:29.996 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ae042c46d9e537fb,8f0c3b944bb35cfc] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=ae042c46d9e537fb, duration=1 ms] 2025-09-16 13:53:29.996 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:53:29.995+08:00 2025-09-16 13:53:29.996 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:53:29.995+08:00 2025-09-16 13:53:29.996 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:53:29.994+08:00 and status AVAILABLE 2025-09-16 13:53:29.997 INFO 9 --- [ForkJoinPool-10-worker-15,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:53:29.997 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:53:29.995+08:00 and status AVAILABLE 2025-09-16 13:53:29.997 INFO 9 --- [ForkJoinPool-10-worker-8,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:53:29.997 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:53:29.995+08:00 and status AVAILABLE 2025-09-16 13:53:29.997 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:29.997 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get tenant session stat of zhengqi 2025-09-16 13:53:29.997 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get session of zhengqi 2025-09-16 13:53:29.998 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2025-09-16 13:53:29.998 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:53:29.995+08:00 and status AVAILABLE 2025-09-16 13:53:29.999 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:53:29.995+08:00 and status AVAILABLE 2025-09-16 13:53:29.999 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:53:29.995+08:00 and status AVAILABLE 2025-09-16 13:53:29.999 INFO 9 --- [pool-12-thread-14,87f316c79a33be93,78a4410b99df4400] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to attach trans id 2025-09-16 13:53:29.999 INFO 9 --- [pool-12-thread-14,87f316c79a33be93,78a4410b99df4400] c.o.o.p.t.i.ObTransactionDiagServiceImpl : finish fetching trans data 2025-09-16 13:53:30.000 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:53:30.001 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:53:30.003 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:53:30.003 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:53:30.003 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:53:30.003 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:53:30.004 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.005 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:53:30.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:53:30.005242+08:00, lastProcessTime=2025-09-16T13:53:20.003405+08:00 2025-09-16 13:53:30.007 INFO 9 --- [pool-overview-container-2,b224bfa53749ae75,ecc8793cd40ba6e6] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.009 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:30.009 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:30.009 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:30.010 INFO 9 --- [pool-overview-container-2,b224bfa53749ae75,ecc8793cd40ba6e6] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ SVR_IP, SVR_PORT, ZONE, CPU_CAPACITY, CPU_CAPACITY_MAX, CPU_ASSIGNED, CPU_ASSIGNED_MAX, MEM_CAPACITY, MEM_CAPACITY AS MEM_CAPACITY_MAX, MEM_ASSIGNED, MEM_ASSIGNED AS MEM_ASSIGNED_MAX, LOG_DISK_CAPACITY, LOG_DISK_ASSIGNED, LOG_DISK_IN_USE, DATA_DISK_CAPACITY, DATA_DISK_IN_USE FROM oceanbase.GV$OB_SERVERS 2025-09-16 13:53:30.010 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:30.010 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:30.010 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:30.010 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:30.010 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.011 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:30.013 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.159, 2882] 2025-09-16 13:53:30.014 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:30.014 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.015 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:30.016 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.111, 2882] 2025-09-16 13:53:30.017 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.019 INFO 9 --- [pool-12-thread-13,87f316c79a33be93,5851a37607d78345] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster anomaly sql Stat 2025-09-16 13:53:30.019 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.104, 2882] 2025-09-16 13:53:30.020 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.022 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.85, 2882] 2025-09-16 13:53:30.023 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.024 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.024 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:30.024 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:30.025 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:30.025 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.54, 2882] 2025-09-16 13:53:30.025 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:30.025 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:53:30.025 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:30.026 INFO 9 --- [ocp-schedules-1,1e38a03cf4d1d6fa,b2ddb850a1862759] .o.o.s.t.b.c.AbstractShardingClusterTask : Check root service executed completed, allCount=1, successCount=1 2025-09-16 13:53:30.026 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:30.028 INFO 9 --- [pool-12-thread-13,87f316c79a33be93,5851a37607d78345] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching cluster sql stat 2025-09-16 13:53:30.029 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:30.035 INFO 9 --- [host-check-agent-status3,d0701f3bf06c0553,7c16ae48d95bedb9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:53:30.038 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.038 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:53:30.040 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:53:30.040 INFO 9 --- [host-check-agent-status3,d0701f3bf06c0553,7c16ae48d95bedb9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:53:30.040 INFO 9 --- [host-check-agent-status3,d0701f3bf06c0553,7c16ae48d95bedb9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:53:30.040 INFO 9 --- [host-check-agent-status3,d0701f3bf06c0553,7c16ae48d95bedb9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:53:30.041 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:53:30.042 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.042 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.043 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:53:30.043 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:53:30.045 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:30.046 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.047 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:53:30.050 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.051 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:53:30.052 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:53:30.052 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:53:30.054 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:53:30.058 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:53:30.060 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:53:30.060 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:53:30.063 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:53:30.064 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:53:30.065 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:53:30.067 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:53:30.068 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.068 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:53:30.069 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:53:30.073 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.074 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:53:30.075 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.075 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:53:30.075 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:30.077 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:30.078 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:30.079 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:30.079 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:30.080 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:53:30.083 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:30.084 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.085 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:53:30.086 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:53:30.088 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.092 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:53:30.094 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:30.094 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:53:30.096 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.097 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:53:30.100 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.101 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:53:30.101 INFO 9 --- [prometheus-second-schedule-1,4bd636e488e84add,8185d7ca5eb09235] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:53:30.104 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:53:30.105 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:53:30.105 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.105 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:53:30.106 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.106 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:53:30.107 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:53:30.107 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:53:30.108 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:53:30.108 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get deadlock of zhengqi 2025-09-16 13:53:30.110 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:53:30.111 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:53:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:30.112 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:53:30.113 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:53:30.114 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:53:30.114 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:53:30.121 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:53:30.123 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:30.124 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:53:30.124 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:30.126 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:30.126 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:30.127 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:30.130 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.130 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:30.130 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.131 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:53:30, 2025-09-16 13:53:30] 2025-09-16 13:53:30.134 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.134 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:53:30.135 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:53:30.142 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:53:30.005242+08:00 2025-09-16 13:53:30.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:30.150 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:53:30.151 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:53:30.152 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:53:30.152 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.153 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:53:30.153 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:53:30.153 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:53:30.153 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:53:30.155 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.155 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.156 INFO 9 --- [ForkJoinPool-10-worker-15,87f316c79a33be93,3e68738cfbf0ae5a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:53:30.156 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:53:30, 2025-09-16 13:53:30] 2025-09-16 13:53:30.156 INFO 9 --- [host-check-host-status3,dbece03ccc469003,5d6e467ca022455f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:53:30.158 INFO 9 --- [host-check-host-status2,dbece03ccc469003,41a82bfcc85bea9c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:53:30.158 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:53:30.159 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.159 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:30.160 INFO 9 --- [host-check-host-status1,dbece03ccc469003,5a73c4f97f9d75c0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:53:30.160 INFO 9 --- [host-check-host-status4,dbece03ccc469003,70e1f173267b06ed] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:53:30.160 INFO 9 --- [pool-12-thread-15,87f316c79a33be93,b1ce98e0c6d3569f] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2025-09-16 13:53:30.162 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:53:30.164 INFO 9 --- [host-check-host-status6,dbece03ccc469003,4df3ca13d16f8da6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:53:30.168 INFO 9 --- [host-check-host-status5,dbece03ccc469003,244c723c456a5072] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:53:30.173 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.173 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:30.174 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:53:30.176 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.177 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:53:30, 2025-09-16 13:53:30] 2025-09-16 13:53:30.179 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.p.o.i.OasSessionStatServiceImpl : finish fetching tenant session data of zhengqi 2025-09-16 13:53:30.179 INFO 9 --- [ForkJoinPool-10-worker-8,87f316c79a33be93,ed73f5a65f3cfef7] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching tenant session stat of zhengqi 2025-09-16 13:53:30.179 INFO 9 --- [pool-12-thread-16,87f316c79a33be93,8f34a5e2ca9af9bb] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2025-09-16 13:53:30.183 INFO 9 --- [ocp-async-4,65685aba1334f996,5b971377386fa158] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:53:30.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:30.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:30.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.218 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:53:30.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.231 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:53:30.247 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:53:30.260 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:30.261 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.262 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:53:30.267 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:53:30.270 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:53:30.271 INFO 9 --- [ocp-schedules-22,e43420d89c55acc6,ecb8abadced032fd] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:53:30.272 INFO 9 --- [ocp-schedules-22,e43420d89c55acc6,ecb8abadced032fd] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:30.273 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:53:30.273 INFO 9 --- [ocp-schedules-22,e43420d89c55acc6,ecb8abadced032fd] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:53:30.273 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:30.274 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:30.287 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:53:30.348 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:53:30.363 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:30.364 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:30.365 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:53:30.379 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:53:30.379 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:53:30.379 INFO 9 --- [ocp-schedules-30,1bdddb3e42e7e188,08a337cc744433fa] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:53:30.399 INFO 9 --- [ocp-schedules-6,eacbcf1b227d8363,c9470bb6ed71ef69] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:53:30.504 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:30.505 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:30.576 INFO 9 --- [ocp-schedules-21,80040a401874af05,bafe3a0f6849a276] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:53:30.588 INFO 9 --- [ocp-schedules-21,80040a401874af05,bafe3a0f6849a276] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:53:30.588 INFO 9 --- [ocp-schedules-21,80040a401874af05,bafe3a0f6849a276] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:53:30.788 WARN 9 --- [ocp-async-7,e470ec01d6e4248a,f97d7bf7e86de5c3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:30.788 INFO 9 --- [ocp-async-10,143c6794ccd53a19,36f80f7f0743050c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:30.842 INFO 9 --- [ocp-schedules-15,ad2922d520ea1d0f,aff5dcd5cac686d9] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:53:30.974 INFO 9 --- [ocp-schedules-20,86b38b9d18498568,10d978533344183f] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:53:30.974 INFO 9 --- [ocp-schedules-20,86b38b9d18498568,10d978533344183f] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:53:30.977 INFO 9 --- [ocp-schedules-29,38287ee2fe9ee20f,dbcf8e4447c7e87c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:53:30.982 WARN 9 --- [scanner-1374701-1,38287ee2fe9ee20f,37488b2ad0c237f5] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:53:31.468 INFO 9 --- [ocp-schedules-14,2a8b6cd2afc6c7a1,056e3dd37282478b] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:53:31.468 INFO 9 --- [ocp-schedules-14,2a8b6cd2afc6c7a1,056e3dd37282478b] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002011 2025-09-16 13:53:31.471 INFO 9 --- [ocp-schedules-14,2a8b6cd2afc6c7a1,056e3dd37282478b] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:53:31.630 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2025-09-16 13:53:31.630 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2025-09-16 13:53:31.633 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2025-09-16 13:53:31.633 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: binlogQueryCache 2025-09-16 13:53:31.633 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.c.cache.helper.BinlogQueryCache : Init binlog cache. 2025-09-16 13:53:31.636 INFO 9 --- [prometheus-minute-schedule-1,bd4818e29c239f6f,2f6db182aef2b2aa] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:31.636 INFO 9 --- [ocp-schedules-22,58e0c2ee9f8e15a0,7fcde8f22b7f489e] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:53:31.639 INFO 9 --- [prometheus-minute-schedule-1,bd4818e29c239f6f,2f6db182aef2b2aa] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:31.639 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.c.cache.helper.BinlogQueryCache : Finish init binlog cache. 2025-09-16 13:53:31.639 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2025-09-16 13:53:31.639 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2025-09-16 13:53:31.649 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2025-09-16 13:53:31.649 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2025-09-16 13:53:31.649 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2025-09-16 13:53:31.652 INFO 9 --- [ocp-schedules-27,bf6ea416b45a51a0,241289fec89c8738] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2025-09-16 13:53:31.690 INFO 9 --- [ocp-schedules-5,db51c4bdbe943867,f385b5d4c6a6188d] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:53:31.690 INFO 9 --- [ocp-schedules-5,db51c4bdbe943867,f385b5d4c6a6188d] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408518824476672 2025-09-16 13:53:31.691 INFO 9 --- [ocp-schedules-12,ab0ff7c3a1280aa5,00ea0f48844f5e41] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:53:31.693 INFO 9 --- [ocp-schedules-5,db51c4bdbe943867,f385b5d4c6a6188d] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=1, maxSyncedRecordId=824442618499219456 2025-09-16 13:53:31.693 INFO 9 --- [ocp-schedules-5,db51c4bdbe943867,f385b5d4c6a6188d] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:53:31.693 INFO 9 --- [ocp-schedules-5,db51c4bdbe943867,f385b5d4c6a6188d] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:53:31.696 INFO 9 --- [ocp-schedules-5,db51c4bdbe943867,f385b5d4c6a6188d] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:53:31.696 INFO 9 --- [ocp-schedules-5,db51c4bdbe943867,f385b5d4c6a6188d] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:53:31.730 INFO 9 --- [host-check-clockdiff6,f65e1159144f31cd,f549e53bf8e88411] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002011 -2 -2 , error= 2025-09-16 13:53:32.788 WARN 9 --- [ocp-async-4,2fe5c2bc1ffcdb34,3170de04d7c45927] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:32.788 INFO 9 --- [ocp-async-6,9c06663bfd062e6e,53c4246067c47c41] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:32.865 INFO 9 --- [ocp-schedules-14,8a76bc0649e7ac22,7b7fef5d19f25e02] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2025-09-16 13:53:32.865 INFO 9 --- [ocp-schedules-14,8a76bc0649e7ac22,7b7fef5d19f25e02] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2025-09-16 13:53:32.880 INFO 9 --- [pool-70-thread-1,8a76bc0649e7ac22,74b0f9caba84f2d2] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect mini compaction info 2025-09-16 13:53:32.903 INFO 9 --- [pool-70-thread-1,8a76bc0649e7ac22,74b0f9caba84f2d2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:32.906 INFO 9 --- [pool-70-thread-1,8a76bc0649e7ac22,74b0f9caba84f2d2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, MIN(unix_timestamp(`start_time`)*1000000) AS min_start_time, MAX(unix_timestamp(`finish_time`)*1000000) AS max_finish_time, SUM(occupy_size) AS occupy_size, SUM(total_row_count) AS total_row_count, COUNT(1) AS tablet_count FROM GV$OB_TABLET_COMPACTION_HISTORY WHERE type = 'MINI_MERGE' AND unix_timestamp(`finish_time`)*1000000 > ? AND unix_timestamp(`finish_time`)*1000000 <= ? GROUP BY tenant_id;, args: [1758001712000000, 1758002012000000] 2025-09-16 13:53:32.926 INFO 9 --- [pool-70-thread-1,8a76bc0649e7ac22,74b0f9caba84f2d2] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect mini compaction info 2025-09-16 13:53:32.927 INFO 9 --- [ocp-schedules-14,8a76bc0649e7ac22,7b7fef5d19f25e02] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2025-09-16 13:53:33.409 INFO 9 --- [ocp-schedules-1,a9430f80ad10ed77,c5a3dbdb88d26078] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:53:33.505 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:33.505 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:33.542 INFO 9 --- [ocp-schedules-9,f57b68e4121dbf6a,b2b01da184a2054d] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:53:33.542+08:00, clusters=[1] 2025-09-16 13:53:33.544 INFO 9 --- [ocp-schedules-9,f57b68e4121dbf6a,b2b01da184a2054d] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:53:34.102 INFO 9 --- [ocp-schedules-25,019043b0abf6d65b,f6c76d4eed7d2803] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:53:34.102 INFO 9 --- [ocp-schedules-25,019043b0abf6d65b,f6c76d4eed7d2803] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:53:34.104 INFO 9 --- [ocp-schedules-25,019043b0abf6d65b,f6c76d4eed7d2803] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:53:34.120 INFO 9 --- [ocp-schedules-25,019043b0abf6d65b,f6c76d4eed7d2803] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:53:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:53:34.632 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2025-09-16 13:53:34.636 INFO 9 --- [prometheus-minute-schedule-1,a2f85607059b3db3,d27cda692126c8b0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:34.637 INFO 9 --- [ocp-schedules-26,38ee69b0895acd83,4280acb093120d13] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:53:34.640 INFO 9 --- [prometheus-minute-schedule-1,a2f85607059b3db3,d27cda692126c8b0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:34.642 INFO 9 --- [ocp-schedules-26,38ee69b0895acd83,4280acb093120d13] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:53:34.642 INFO 9 --- [ocp-schedules-26,38ee69b0895acd83,4280acb093120d13] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:53:34.644 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:34.645 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:34.660 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:34.661 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:34.675 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:34.675 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:34.689 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:34.690 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:34.704 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:34.704 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:34.718 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:34.719 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:34.732 INFO 9 --- [ocp-schedules-23,9d20dbed35e61fc6,d50e73432e505768] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper finished, credentialSize=6, cachedSize=6 2025-09-16 13:53:34.751 INFO 9 --- [ocp-schedules-27,f1560f37c346a55e,9f395c1ba2213ddd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:53:34.788 WARN 9 --- [ocp-async-8,194bc0bc16aee0d5,1364f52af9149adc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:34.789 INFO 9 --- [ocp-async-8,57caabb12e298ae3,bd42280b882d8954] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:35.587 INFO 9 --- [ocp-schedules-4,f5a74f3b1140c299,7d8aa234b26cfc80] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:53:35.587+08:00, clusters=[1] 2025-09-16 13:53:35.590 INFO 9 --- [ocp-schedules-4,f5a74f3b1140c299,7d8aa234b26cfc80] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:53:36.506 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:36.506 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:36.789 WARN 9 --- [ocp-async-9,23f4a7ab5ab4a447,7064a4bff7c5f1de] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:36.789 INFO 9 --- [ocp-async-5,b4e27c6b9e58ee4c,085206c2ef0bf83a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:37.636 INFO 9 --- [prometheus-minute-schedule-1,6d2012edc11056e4,d95139623b2feceb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:37.639 INFO 9 --- [prometheus-minute-schedule-1,6d2012edc11056e4,d95139623b2feceb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:37.713 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,9df11129930c1cb3,9082a979d4963303] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=9df11129930c1cb3, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:53:37.713 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,9df11129930c1cb3,9082a979d4963303] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=9df11129930c1cb3, duration=1 ms] 2025-09-16 13:53:37.770 INFO 9 --- [ocp-schedules-13,4515945e5f638aa8,3cbcdaee95e501a4] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:53:37.772 INFO 9 --- [ocp-schedules-13,4515945e5f638aa8,3cbcdaee95e501a4] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:37.791 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:37.792 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:53:37.805 INFO 9 --- [ocp-schedules-13,4515945e5f638aa8,3cbcdaee95e501a4] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:53:38.789 WARN 9 --- [ocp-async-10,f5f155cc95892e48,b183157f5bb38929] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:38.789 INFO 9 --- [ocp-async-1,acdaa017bacffafb,58be29cf36b07727] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:39.020 INFO 9 --- [ocp-schedules-5,0d24bcef86c6978e,c79a04658575ec56] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:53:39.022 INFO 9 --- [ocp-schedules-5,0d24bcef86c6978e,c79a04658575ec56] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:53:39.506 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:39.507 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:39.820 INFO 9 --- [ocp-schedules-17,89078acb32216814,798c735ddd5f892d] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:53:39.820 INFO 9 --- [ocp-schedules-17,89078acb32216814,798c735ddd5f892d] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:53:39.833 INFO 9 --- [ocp-schedules-10,8db23912bdb31268,c096c7cfdfa65a44] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:53:39.833 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:53:39.833 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:53:39.833 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:53:39.833 INFO 9 --- [ocp-schedules-10,8db23912bdb31268,c096c7cfdfa65a44] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:53:39.834 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:53:39.835 INFO 9 --- [Collect all tenants major compactions1,89078acb32216814,30a26a05f2e276cd] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:53:39.836 INFO 9 --- [Collect all tenants major compactions3,89078acb32216814,bf68f371219452c2] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:53:39.836 INFO 9 --- [Collect all tenants major compactions2,89078acb32216814,fc74f9b60954d45d] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:53:39.837 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:39.837 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:39.837 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:39.837 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:39.838 INFO 9 --- [ocp-schedules-10,8db23912bdb31268,c096c7cfdfa65a44] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:39.838 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:39.838 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:39.838 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:39.838 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:39.839 INFO 9 --- [ocp-schedules-10,8db23912bdb31268,c096c7cfdfa65a44] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:39.852 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:53:39.853 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:53:39.853 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:53:39.853 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:53:39.853 INFO 9 --- [ocp-schedules-10,8db23912bdb31268,c096c7cfdfa65a44] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:53:39.854 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:53:39.857 INFO 9 --- [Collect all tenants major compactions2,89078acb32216814,fc74f9b60954d45d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:39.858 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:39.858 INFO 9 --- [Collect all tenants major compactions1,89078acb32216814,30a26a05f2e276cd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:39.858 INFO 9 --- [Collect all tenants major compactions3,89078acb32216814,bf68f371219452c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:39.858 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:39.858 INFO 9 --- [Collect all tenants major compactions2,89078acb32216814,fc74f9b60954d45d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:53:39.859 INFO 9 --- [Collect all tenants major compactions1,89078acb32216814,30a26a05f2e276cd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:53:39.859 INFO 9 --- [Collect all tenants major compactions3,89078acb32216814,bf68f371219452c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:53:39.862 INFO 9 --- [Collect all tenants major compactions1,89078acb32216814,30a26a05f2e276cd] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:53:39.864 INFO 9 --- [Collect all tenants major compactions3,89078acb32216814,bf68f371219452c2] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:53:39.865 INFO 9 --- [Collect all tenants major compactions2,89078acb32216814,fc74f9b60954d45d] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:53:39.866 INFO 9 --- [ocp-schedules-17,89078acb32216814,798c735ddd5f892d] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:53:39.872 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:53:39.874 INFO 9 --- [ocp-schedules-10,8db23912bdb31268,c096c7cfdfa65a44] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:53:40.002 INFO 9 --- [ocp-schedules-8,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:53:40.002 INFO 9 --- [ocp-schedules-16,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:53:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:53:40.004646+08:00, lastProcessTime=2025-09-16T13:53:30.005242+08:00 2025-09-16 13:53:40.123 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:53:40.004646+08:00 2025-09-16 13:53:40.183 INFO 9 --- [ocp-async-9,6e316273039b7832,d6c4dcb147809b1c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:53:40.636 INFO 9 --- [prometheus-minute-schedule-1,0b19a51f99cfbde9,68c3068880fc3be7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:40.639 INFO 9 --- [prometheus-minute-schedule-1,0b19a51f99cfbde9,68c3068880fc3be7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:40.789 WARN 9 --- [ocp-async-2,010a2061b318f633,89ee31c552e1ec4f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:40.789 INFO 9 --- [ocp-async-2,6bcddcad7401a5dc,0d59ebd0cd4ef5cb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:40.960 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:49:40.768, end=2025-09-16T13:51:40.958} 2025-09-16 13:53:40.963 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false 2025-09-16 13:53:40.963 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:53:40.965 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:49:40.768, end=2025-09-16T13:51:40.958},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:53:40.965 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:53:40.965 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:53:40.971 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:53:40.972 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:49:40.768, end=2025-09-16T13:51:40.958},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:53:40.972 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:53:40.972 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:53:40.977 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:53:40.982 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:49:40.768, end=2025-09-16T13:51:40.958},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:53:40.982 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:53:40.982 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:53:40.991 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:53:41.005 INFO 9 --- [ocp-schedules-19,a58ed468ab44f87a,bb89db4dba394c77] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:53:41.011 WARN 9 --- [scanner-1374825-1,a58ed468ab44f87a,8e4b774e0adfdfcf] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:53:42.279 INFO 9 --- [ocp-schedules-16,269e58262f9e12ff,077410d17f056195] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:53:42.279 INFO 9 --- [ocp-schedules-16,269e58262f9e12ff,077410d17f056195] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:53:42.316 INFO 9 --- [ocp-schedules-16,269e58262f9e12ff,077410d17f056195] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:42.317 INFO 9 --- [ocp-schedules-16,269e58262f9e12ff,077410d17f056195] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:53:42.507 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:42.507 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:42.789 WARN 9 --- [ocp-async-9,73c47d4ede8207d3,b640b71400ce8b8d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:42.789 INFO 9 --- [ocp-async-9,e1b60576a101d53f,448e861e7ae53482] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:43.636 INFO 9 --- [prometheus-minute-schedule-1,a3626b3835cac481,e1763306d3fb285e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:43.639 INFO 9 --- [prometheus-minute-schedule-1,a3626b3835cac481,e1763306d3fb285e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:44.332 INFO 9 --- [ocp-schedules-27,4318b488b9c3ef6c,2fb2e34da145d70f] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:53:44.333 INFO 9 --- [ocp-schedules-27,4318b488b9c3ef6c,2fb2e34da145d70f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:44.386 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:53:44.387 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.389 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:53:44.413 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.414 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:53:44.434 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.434 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:53:44.459 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.460 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:53:44.465 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.465 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:53:44.504 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.505 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:53:44.528 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.529 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:53:44.533 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.534 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:53:44.557 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.558 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:53:44.581 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.582 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:53:44.603 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.604 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:53:44.605 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.606 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:53:44.607 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.607 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:53:44.608 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.609 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:53:44.609 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.610 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:53:44.611 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.611 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:53:44.626 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.627 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:53:44.628 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.629 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:53:44.629 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.630 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:53:44.644 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:53:44.648 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:53:44.671 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:53:44.672 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:44.673 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:53:44.702 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:53:44.702 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:53:44.702 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:53:44.702 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:53:44.702 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:53:44.702 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:53:44.704 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:53:44.704 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:53:44.704 INFO 9 --- [ocp-schedules-27,4318b488b9c3ef6c,2fb2e34da145d70f] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:53:44.755 INFO 9 --- [ocp-schedules-15,7b1e80dcf191ff54,7c3bd9b5da3af3be] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:53:44.789 WARN 9 --- [ocp-async-9,93bb0a9244b9026d,90be2c4926e93874] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:44.789 INFO 9 --- [ocp-async-1,9b15e3d90adb4cce,e57bdcce8b6df479] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:45.507 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:45.508 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 13:53:45,971 |-INFO in ReconfigureOnChangeTask(born:1758001965970) - Empty watch file list. Disabling 2025-09-16 13:53:46.636 INFO 9 --- [prometheus-minute-schedule-1,9218f57240618437,c00dcf1a2ce13e47] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:46.639 INFO 9 --- [prometheus-minute-schedule-1,9218f57240618437,c00dcf1a2ce13e47] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:46.789 WARN 9 --- [ocp-async-1,08e9a6b2074c2c72,77cd55829ac1fc24] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:46.789 INFO 9 --- [ocp-async-7,e0ca99e958e722a3,c4ecca5f1260c284] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:48.508 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:48.509 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:48.789 WARN 9 --- [ocp-async-8,5ac63dac49f94f69,d30cbb19c5cf1bc8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:48.789 INFO 9 --- [ocp-async-10,34dfc7e7706d3d86,5b338c319443c515] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:49.027 INFO 9 --- [ocp-schedules-12,1fb1ecba0873beae,60e709f48c01119c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:53:49.029 INFO 9 --- [ocp-schedules-12,1fb1ecba0873beae,60e709f48c01119c] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:53:49.636 INFO 9 --- [prometheus-minute-schedule-1,183c47826357f34f,910b21f053c55b94] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:49.639 INFO 9 --- [prometheus-minute-schedule-1,183c47826357f34f,910b21f053c55b94] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:53:50.003369+08:00, lastProcessTime=2025-09-16T13:53:40.004646+08:00 2025-09-16 13:53:50.123 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:53:50.003369+08:00 2025-09-16 13:53:50.183 INFO 9 --- [ocp-async-1,f1687aa8e75bfcb1,46b4f410d4e3ec7b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:53:50.789 WARN 9 --- [ocp-async-4,bf635a5405130f75,559334c9fcfd93bb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:50.789 INFO 9 --- [ocp-async-6,ddcd99bf3763c564,f0fc62c01020b002] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:51.038 INFO 9 --- [ocp-schedules-5,ca3d53994f84736a,ec09eb053910b712] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:53:51.044 WARN 9 --- [scanner-1374987-1,ca3d53994f84736a,d2594270f773a806] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:53:51.509 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:51.509 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:52.636 INFO 9 --- [prometheus-minute-schedule-1,0617468ba887cb92,7d69e047ee38701a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:52.640 INFO 9 --- [prometheus-minute-schedule-1,0617468ba887cb92,7d69e047ee38701a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:52.790 INFO 9 --- [ocp-async-3,01b9ea3fe4b3fcfa,1eed799b835dfa61] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:52.790 WARN 9 --- [ocp-async-7,fa237f44931a5ca6,001a35cd04162da1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:54.509 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:54.510 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:54.644 INFO 9 --- [ocp-schedules-25,c0c7b36da50dd6e1,0c82ba458a3103c1] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:53:54.649 INFO 9 --- [ocp-schedules-25,c0c7b36da50dd6e1,0c82ba458a3103c1] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:53:54.649 INFO 9 --- [ocp-schedules-25,c0c7b36da50dd6e1,0c82ba458a3103c1] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:53:54.757 INFO 9 --- [ocp-schedules-14,b1f41c0df1b89566,7be0352dd4ba2333] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:53:54.790 INFO 9 --- [ocp-async-2,1c7eeecacc1aba50,b85a3f7804096d1a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:54.790 WARN 9 --- [ocp-async-10,e63148b237b8dde2,b8c5b4f8248d5253] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:55.636 INFO 9 --- [prometheus-minute-schedule-1,81d7c57df2bd89b2,3bcfe4183b3926a4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:55.640 INFO 9 --- [prometheus-minute-schedule-1,81d7c57df2bd89b2,3bcfe4183b3926a4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:56.790 WARN 9 --- [ocp-async-9,1fccff53e49f557e,12283f4b010b4516] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:56.790 INFO 9 --- [ocp-async-4,f2fe536bf96a5469,e72581889ff0d463] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:57.510 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:53:57.511 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:53:58.636 INFO 9 --- [prometheus-minute-schedule-1,3b06112f32cd9d9c,efa5408d678f8895] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002040, interval=60 2025-09-16 13:53:58.639 INFO 9 --- [prometheus-minute-schedule-1,3b06112f32cd9d9c,efa5408d678f8895] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:53:58.790 INFO 9 --- [ocp-async-6,e1c6409aecdd7f27,65294616c1db3993] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:53:58.790 WARN 9 --- [ocp-async-1,47e2ce90039a15c6,54636b5450f583aa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:53:59.034 INFO 9 --- [ocp-schedules-7,2007b17595d8d72f,15a72b39695a240e] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:53:59.036 INFO 9 --- [ocp-schedules-7,2007b17595d8d72f,15a72b39695a240e] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:53:59.938 INFO 9 --- [ocp-schedules-30,11ef4e9dd3b46f35,73ef43233eba280d] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:53:59.941 INFO 9 --- [ocp-schedules-3,373087b75fb579b7,42544acd6f2c86c5] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:53:59.941 INFO 9 --- [ocp-schedules-30,0a86bd59f033229f,53828ca6c15135c5] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:53:59.942 INFO 9 --- [ocp-schedules-13,e1a6b3a7d4de4e23,03cb966630e5c507] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:53:59.943 INFO 9 --- [ocp-schedules-30,0a86bd59f033229f,53828ca6c15135c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:59.943 INFO 9 --- [ocp-schedules-3,373087b75fb579b7,42544acd6f2c86c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:59.944 INFO 9 --- [ocp-schedules-13,e1a6b3a7d4de4e23,03cb966630e5c507] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:53:59.944 INFO 9 --- [ocp-schedules-13,e1a6b3a7d4de4e23,03cb966630e5c507] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:53:59.944 INFO 9 --- [ocp-schedules-24,677d408613e144ed,804cea1ede57b930] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:53:59.944 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:53:59.944 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:53:59.944 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:53:59.945 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:53:59.945 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:53:59.945 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:53:59.946 INFO 9 --- [ocp-schedules-9,999f54c294767bf2,ac0046ccc005928e] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:53:59.946 INFO 9 --- [host-check-clockdiff1,999f54c294767bf2,2f2c86832c10be57] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:53:59.946 INFO 9 --- [host-check-clockdiff2,999f54c294767bf2,1feda14eb2c57ea7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:53:59.946 INFO 9 --- [host-check-clockdiff3,999f54c294767bf2,9435bc04a169e491] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:53:59.946 INFO 9 --- [ocp-schedules-28,b23f9f104c3c9191,8d7bc81b200311ca] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:53:59.946 INFO 9 --- [host-check-clockdiff4,999f54c294767bf2,ae19530fd0106610] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:53:59.946 INFO 9 --- [host-check-clockdiff5,999f54c294767bf2,34a7cd61a2704b37] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:53:59.946 INFO 9 --- [host-check-clockdiff6,999f54c294767bf2,fc2c6428f2a839a6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:53:59.946 INFO 9 --- [host-check-agent-status1,b23f9f104c3c9191,e5509a0a08ef4633] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:53:59.946 INFO 9 --- [host-check-agent-status2,b23f9f104c3c9191,4ed255aa72582326] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:53:59.947 INFO 9 --- [host-check-agent-status3,b23f9f104c3c9191,1af3297273ebf7b6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:53:59.947 INFO 9 --- [host-check-agent-status4,b23f9f104c3c9191,af649c3285fa363c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:53:59.947 INFO 9 --- [host-check-agent-status5,b23f9f104c3c9191,812165fdb54ff123] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:53:59.947 INFO 9 --- [host-check-agent-status6,b23f9f104c3c9191,dca44f27652e1bf2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:53:59.948 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:59.951 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:59.951 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:59.951 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:59.951 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:59.951 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:59.951 INFO 9 --- [ocp-schedules-2,1d35c9cf4deadf98,4c5cf3887e9115a8] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:53:59.953 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:59.953 INFO 9 --- [host-check-clockdiff3,999f54c294767bf2,9435bc04a169e491] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002039 -1 -1 , error= 2025-09-16 13:53:59.955 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:59.955 INFO 9 --- [host-check-clockdiff1,999f54c294767bf2,2f2c86832c10be57] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002039 -1 -1 , error= 2025-09-16 13:53:59.955 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:59.956 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:59.956 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:59.956 INFO 9 --- [host-check-clockdiff2,999f54c294767bf2,1feda14eb2c57ea7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002039 -1 -1 , error= 2025-09-16 13:53:59.956 INFO 9 --- [host-check-agent-status1,b23f9f104c3c9191,e5509a0a08ef4633] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:59.956 INFO 9 --- [host-check-clockdiff5,999f54c294767bf2,34a7cd61a2704b37] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002039 -2 -2 , error= 2025-09-16 13:53:59.956 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:59.957 INFO 9 --- [host-check-agent-status4,b23f9f104c3c9191,af649c3285fa363c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:59.957 INFO 9 --- [host-check-agent-status3,b23f9f104c3c9191,1af3297273ebf7b6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:59.957 INFO 9 --- [host-check-agent-status2,b23f9f104c3c9191,4ed255aa72582326] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:59.957 INFO 9 --- [host-check-agent-status5,b23f9f104c3c9191,812165fdb54ff123] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:59.957 INFO 9 --- [host-check-agent-status1,b23f9f104c3c9191,e5509a0a08ef4633] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:59.957 INFO 9 --- [host-check-agent-status6,b23f9f104c3c9191,dca44f27652e1bf2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:59.957 INFO 9 --- [host-check-agent-status4,b23f9f104c3c9191,af649c3285fa363c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:59.958 INFO 9 --- [host-check-agent-status2,b23f9f104c3c9191,4ed255aa72582326] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:59.958 INFO 9 --- [host-check-agent-status3,b23f9f104c3c9191,1af3297273ebf7b6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:59.958 INFO 9 --- [host-check-agent-status5,b23f9f104c3c9191,812165fdb54ff123] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:59.958 INFO 9 --- [host-check-agent-status6,b23f9f104c3c9191,dca44f27652e1bf2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:59.970 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:59.970 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:53:59.970 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:53:59.970 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:53:59.970 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:53:59.971 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:53:59.971 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:53:59.971 INFO 9 --- [host-check-agent-status1,b23f9f104c3c9191,e5509a0a08ef4633] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:53:59.971 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:53:59.972 INFO 9 --- [host-check-agent-status4,b23f9f104c3c9191,af649c3285fa363c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:53:59.972 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:53:59.970941868+08:00 2025-09-16 13:53:59.972 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:53:59.971482180+08:00 2025-09-16 13:53:59.972 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:53:59.971012338+08:00 2025-09-16 13:53:59.972 INFO 9 --- [host-check-agent-status5,b23f9f104c3c9191,812165fdb54ff123] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:53:59.972 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:53:59.971629432+08:00 2025-09-16 13:53:59.972 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:53:59.972+08:00 2025-09-16 13:53:59.972 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:53:59.971492064+08:00 2025-09-16 13:53:59.972 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:53:59.972+08:00 2025-09-16 13:53:59.973 INFO 9 --- [host-check-agent-status2,b23f9f104c3c9191,4ed255aa72582326] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:53:59.973 INFO 9 --- [host-check-agent-status3,b23f9f104c3c9191,1af3297273ebf7b6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:53:59.973 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:53:59.971578058+08:00 2025-09-16 13:53:59.973 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:53:59.972+08:00 2025-09-16 13:53:59.973 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:53:59.972+08:00 2025-09-16 13:53:59.973 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:53:59.972+08:00 2025-09-16 13:53:59.973 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:53:59.973+08:00 2025-09-16 13:53:59.974 INFO 9 --- [host-check-agent-status6,b23f9f104c3c9191,dca44f27652e1bf2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:53:59.974 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:53:59.972+08:00 and status AVAILABLE 2025-09-16 13:53:59.974 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:53:59.972+08:00 and status AVAILABLE 2025-09-16 13:53:59.975 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:53:59.972+08:00 and status AVAILABLE 2025-09-16 13:53:59.975 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:53:59.973+08:00 and status AVAILABLE 2025-09-16 13:53:59.975 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:53:59.972+08:00 and status AVAILABLE 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status4,b23f9f104c3c9191,af649c3285fa363c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status4,b23f9f104c3c9191,af649c3285fa363c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status4,b23f9f104c3c9191,af649c3285fa363c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status5,b23f9f104c3c9191,812165fdb54ff123] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status5,b23f9f104c3c9191,812165fdb54ff123] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:53:59.975 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:53:59.972+08:00 and status AVAILABLE 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status5,b23f9f104c3c9191,812165fdb54ff123] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status1,b23f9f104c3c9191,e5509a0a08ef4633] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status1,b23f9f104c3c9191,e5509a0a08ef4633] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status1,b23f9f104c3c9191,e5509a0a08ef4633] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status2,b23f9f104c3c9191,4ed255aa72582326] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status2,b23f9f104c3c9191,4ed255aa72582326] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:53:59.975 INFO 9 --- [host-check-agent-status2,b23f9f104c3c9191,4ed255aa72582326] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:53:59.975 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:53:59.976 INFO 9 --- [ocp-schedules-30,0a86bd59f033229f,53828ca6c15135c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:53:59.976 INFO 9 --- [host-check-agent-status3,b23f9f104c3c9191,1af3297273ebf7b6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:53:59.976 INFO 9 --- [host-check-agent-status3,b23f9f104c3c9191,1af3297273ebf7b6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:53:59.976 INFO 9 --- [host-check-agent-status3,b23f9f104c3c9191,1af3297273ebf7b6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:53:59.978 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:53:59.979 INFO 9 --- [host-check-agent-status6,b23f9f104c3c9191,dca44f27652e1bf2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:53:59.979 INFO 9 --- [host-check-agent-status6,b23f9f104c3c9191,dca44f27652e1bf2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:53:59.979 INFO 9 --- [host-check-agent-status6,b23f9f104c3c9191,dca44f27652e1bf2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:53:59.979 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:53:59.979 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:53:59.980 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:53:59.980 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:53:59.980 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:53:59.984 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:53:59.985 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:53:59.985 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:53:59.986 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:53:59.986 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:53:59.986 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:53:59.986 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:53:59.986 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:53:59.986 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:53:59.986 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:53:59.987 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:53:59.987 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:53:59.987 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:53:59.987 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:53:59.998 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:00.000 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:00.000 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:00.001 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:00.002 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:00.002 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:54:00.003552+08:00, lastProcessTime=2025-09-16T13:53:50.003369+08:00 2025-09-16 13:54:00.024 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:00.025 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:00.026 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:54:00.026 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:54:00.028 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:54:00.029 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:54:00.029 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:54:00.030 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:54:00.030 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:54:00.033 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:54:00.035 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:54:00.035 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:54:00.036 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:54:00.037 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:54:00.037 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:54:00.045 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:00.047 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:00.048 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:00.048 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:00.049 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:00.049 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:00.061 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:00.062 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:00.062 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:54:00.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:00.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:54:00.070 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:00.073 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:54:00.075 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:54:00.076 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:54:00.078 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:54:00.078 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:54:00.078 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:54:00.080 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:54:00.081 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:54:00.082 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:54:00.084 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:54:00.084 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.084 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:54:00.084 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:00.085 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:54:00.092 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:00.093 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:00.093 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:00.096 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:00.097 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:00.098 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:00.101 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.101 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:00.115 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.115 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:00.120 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:54:00.121 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:54:00.124 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:54:00.125 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:54:00.125 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:54:00.126 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:54:00.127 INFO 9 --- [host-check-host-status4,677d408613e144ed,5b0b371a8f74c17c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:54:00.128 INFO 9 --- [host-check-host-status2,677d408613e144ed,b879a84a416163f3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:54:00.131 INFO 9 --- [host-check-host-status5,677d408613e144ed,0e6ee1b99e3ae0ae] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:54:00.131 INFO 9 --- [host-check-host-status3,677d408613e144ed,c6ce8f11088b86af] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:54:00.132 INFO 9 --- [host-check-host-status1,677d408613e144ed,6a1d2812fed17b6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:54:00.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:54:00.003552+08:00 2025-09-16 13:54:00.133 INFO 9 --- [host-check-host-status6,677d408613e144ed,ed57f0082aa2221b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:54:00.133 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.133 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:00.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:00.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:00.183 INFO 9 --- [ocp-async-9,15b8a026d6891427,45afc955278c363f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:54:00.191 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.191 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:00.204 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.204 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:00.220 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:00.233 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:00.235 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:00.235 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:00.241 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:54:00.244 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:54:00.247 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:54:00.323 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:54:00.337 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:00.338 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:00.339 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:54:00.353 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:54:00.353 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:54:00.354 INFO 9 --- [ocp-schedules-3,373087b75fb579b7,42544acd6f2c86c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:54:00.511 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:00.511 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:00.790 INFO 9 --- [ocp-async-10,478181c68471baa7,c1c97ccd2774a547] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:00.790 WARN 9 --- [ocp-async-2,305f23a27997b5e4,cadb549588200597] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:00.844 INFO 9 --- [ocp-schedules-28,14e1dd5f710e7062,6ba2184694ee7522] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:54:00.887 INFO 9 --- [host-check-clockdiff6,999f54c294767bf2,fc2c6428f2a839a6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002040 -2 -2 , error= 2025-09-16 13:54:01.063 INFO 9 --- [ocp-schedules-24,d27854a0390c56c5,0ad92b9d1a191759] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:54:01.069 WARN 9 --- [scanner-1375118-1,d27854a0390c56c5,22bc6e079ce78cb1] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:54:01.636 INFO 9 --- [prometheus-minute-schedule-1,286b14ce2ac9bf77,8a8586f4a48bdd47] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:01.639 INFO 9 --- [prometheus-minute-schedule-1,286b14ce2ac9bf77,8a8586f4a48bdd47] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:01.732 INFO 9 --- [host-check-clockdiff4,999f54c294767bf2,ae19530fd0106610] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002041 -1 -1 , error= 2025-09-16 13:54:02.790 WARN 9 --- [ocp-async-4,ae446132135773f5,363cc7cc2318d1f5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:02.790 INFO 9 --- [ocp-async-5,5b185191408fe0af,4c0b9babff5e6263] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:03.511 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:03.512 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:04.636 INFO 9 --- [prometheus-minute-schedule-1,028b5fb07949d9a4,e010479c28e30d47] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:04.639 INFO 9 --- [prometheus-minute-schedule-1,028b5fb07949d9a4,e010479c28e30d47] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:04.761 INFO 9 --- [ocp-schedules-18,e5c72bed7c38fea5,c1c5f26bae0f1d75] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:54:04.790 WARN 9 --- [ocp-async-6,c3a1b583c71e8e49,bc9db456d75f0972] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:04.790 INFO 9 --- [ocp-async-7,79277315998a7f8d,ed7c2c8ea139382c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:06.512 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:06.512 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:06.790 WARN 9 --- [ocp-async-8,b0333daa6d7a9a2e,ee937603d212eace] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:06.790 INFO 9 --- [ocp-async-2,ed3da5dd0f1f1b17,485cdd7140ba7bae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:07.636 INFO 9 --- [prometheus-minute-schedule-1,2a7a364f92ca04b2,f27624a96de1afa1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:07.639 INFO 9 --- [prometheus-minute-schedule-1,2a7a364f92ca04b2,f27624a96de1afa1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:08.790 WARN 9 --- [ocp-async-9,c19796b824159574,c8cdb78b85db7d6c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:08.790 INFO 9 --- [ocp-async-4,7ccf4a781517c66b,ff2fe6001114ca93] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:09.041 INFO 9 --- [ocp-schedules-20,392a569b983c8da4,ffbe2a1f50d74271] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:54:09.043 INFO 9 --- [ocp-schedules-20,392a569b983c8da4,ffbe2a1f50d74271] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:54:09.513 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:09.513 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:10.002 INFO 9 --- [ocp-schedules-4,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:54:10.002 INFO 9 --- [ocp-schedules-22,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:54:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:54:10.003503+08:00, lastProcessTime=2025-09-16T13:54:00.003552+08:00 2025-09-16 13:54:10.122 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:54:10.003503+08:00 2025-09-16 13:54:10.183 INFO 9 --- [ocp-async-8,d22d586bffbf907a,606a5656b32d6dd1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:54:10.296 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:54:10.636 INFO 9 --- [prometheus-minute-schedule-1,dd632b2a0fa4a7e5,858786a138b79800] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:10.640 INFO 9 --- [prometheus-minute-schedule-1,dd632b2a0fa4a7e5,858786a138b79800] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:10.791 INFO 9 --- [ocp-async-6,a1119b917692315c,bdfad41308de2f1c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:10.791 WARN 9 --- [ocp-async-7,bde6b7a35da3d723,1dd4415d02687f15] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:11.095 INFO 9 --- [ocp-schedules-5,44ef6b06936aa717,df9db590611287b3] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:54:11.100 WARN 9 --- [scanner-1376159-1,44ef6b06936aa717,604904ff2fe1a30c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:54:11.727 INFO 9 --- [metric-archive-async-1,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758001980, nodeCount=460, affectRows=460 2025-09-16 13:54:12.513 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:12.514 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:12.791 INFO 9 --- [ocp-async-8,e26658800018b775,42f212edf7bef3b6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:12.791 WARN 9 --- [ocp-async-2,d4df20ae5efed4d3,ed3c30426634096a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:12.854 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001980, nodeCount=1000, affectRows=1000 2025-09-16 13:54:12.856 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001980, nodeCount=1000, validCount=996 2025-09-16 13:54:12.882 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001980, nodeCount=1000, affectRows=1000 2025-09-16 13:54:12.885 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001980, nodeCount=1000, validCount=998 2025-09-16 13:54:12.895 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697862) Duplicate entry '824401952599621632-1758001920' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697862) Duplicate entry '824401952599621632-1758001920' for key 'PRIMARY' 2025-09-16 13:54:13.091 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001980, nodeCount=853, affectRows=853 2025-09-16 13:54:13.093 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001980, nodeCount=853, validCount=851 2025-09-16 13:54:13.636 INFO 9 --- [prometheus-minute-schedule-1,546e31608360b8a6,5c4a365a96ed0268] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:13.639 INFO 9 --- [prometheus-minute-schedule-1,546e31608360b8a6,5c4a365a96ed0268] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:14.199 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758001980, nodeCount=1000, affectRows=1000 2025-09-16 13:54:14.201 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758001980, nodeCount=991, validCount=945 2025-09-16 13:54:14.650 INFO 9 --- [ocp-schedules-16,77e1f00d00ea2675,917f0ac217c50ec9] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:54:14.655 INFO 9 --- [ocp-schedules-16,77e1f00d00ea2675,917f0ac217c50ec9] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:54:14.655 INFO 9 --- [ocp-schedules-16,77e1f00d00ea2675,917f0ac217c50ec9] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:54:14.764 INFO 9 --- [ocp-schedules-19,5d2dcbfb04047869,dc41a8b4f7ea986c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:54:14.791 INFO 9 --- [ocp-async-9,328881571e1d5ca9,e8fba4cde006e824] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:14.791 WARN 9 --- [ocp-async-4,095f3d796f0fe5a4,79a5b7fdcc4efe67] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:15.514 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:15.515 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:16.636 INFO 9 --- [prometheus-minute-schedule-1,e631684c273f4b25,637f525aee3bf7a9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:16.639 INFO 9 --- [prometheus-minute-schedule-1,e631684c273f4b25,637f525aee3bf7a9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:16.791 INFO 9 --- [ocp-async-5,1c339dcb2d0b1533,d354992bd156c552] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:16.791 WARN 9 --- [ocp-async-1,ed15d673181e9f34,c61d93e4ead318c7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:18.515 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:18.516 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:18.791 INFO 9 --- [ocp-async-6,2c175e5523589c74,0a9ea0ec2d818495] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:18.791 WARN 9 --- [ocp-async-3,7abd6136b2b097e2,3281050d7895bbfc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:19.049 INFO 9 --- [ocp-schedules-2,55f67f23d7872516,26c9881026113dc9] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:54:19.050 INFO 9 --- [ocp-schedules-2,55f67f23d7872516,26c9881026113dc9] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:54:19.636 INFO 9 --- [prometheus-minute-schedule-1,f170f6d49228fdb1,f0b2c52365ca7374] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:19.639 INFO 9 --- [prometheus-minute-schedule-1,f170f6d49228fdb1,f0b2c52365ca7374] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:54:20.003432+08:00, lastProcessTime=2025-09-16T13:54:10.003503+08:00 2025-09-16 13:54:20.115 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:54:20.003432+08:00 2025-09-16 13:54:20.183 INFO 9 --- [ocp-async-1,489f116a54cd2445,6b00d5dd534cfde0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:54:20.636 INFO 9 --- [prometheus-cache-monitor1,1b4222ca9f24d4f9,122a924d32d1b049] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:54:20.636 INFO 9 --- [prometheus-cache-monitor1,1b4222ca9f24d4f9,122a924d32d1b049] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:54:20.791 INFO 9 --- [ocp-async-4,bd91be2faaae53cf,40b645786d67e0ef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:20.791 WARN 9 --- [ocp-async-9,8908f30c10172b77,d5c9de488891cf34] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:21.121 INFO 9 --- [ocp-schedules-16,0b16c54be09021ac,ee89526f3624bade] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:54:21.126 WARN 9 --- [scanner-1376278-1,0b16c54be09021ac,b6ff0e26d303534b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:54:21.516 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:21.516 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:22.636 INFO 9 --- [prometheus-minute-schedule-1,579878ea16d6b14f,1a91b75af8cf6155] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:22.639 INFO 9 --- [prometheus-minute-schedule-1,579878ea16d6b14f,1a91b75af8cf6155] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:22.791 INFO 9 --- [ocp-async-7,fa307df05f040c2f,fd166e481b5bcf73] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:22.791 WARN 9 --- [ocp-async-5,fa635e9ca8fce9bd,c77705cf47b6058a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:24.046 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.049 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitr 2025-09-16 13:54:24.058 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.067 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.075 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.083 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.086 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.089 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.092 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.095 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.098 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.100 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.103 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.105 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:23.958, end=2025-09-16T13:53:24.043} 2025-09-16 13:54:24.105 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2025-09-16 13:54:24.517 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:24.517 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:24.767 INFO 9 --- [ocp-schedules-10,4bf6e6ff4910617f,ed0327f74a40741e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:54:24.791 WARN 9 --- [ocp-async-6,2ef1f7c16b8d97f7,1158193fdf8b1351] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:24.791 INFO 9 --- [ocp-async-2,6d6d52ecedf3c27e,e3312280f9c42e44] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:25.066 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,d334b32d798d5cfa,810e7389ff23d5ef] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=d334b32d798d5cfa, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:54:25.066 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,d334b32d798d5cfa,810e7389ff23d5ef] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=d334b32d798d5cfa, duration=0 ms] 2025-09-16 13:54:25.636 INFO 9 --- [prometheus-minute-schedule-1,10e452aeeb3569e4,4741120fefa36348] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:25.640 INFO 9 --- [prometheus-minute-schedule-1,10e452aeeb3569e4,4741120fefa36348] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:26.792 INFO 9 --- [ocp-async-9,6297d9b16c0ca812,9724ee8e16326fb2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:26.792 WARN 9 --- [ocp-async-10,8d56ddda80bcba41,38aa7bcc08d63ecd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:27.517 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:27.518 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:28.087 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.090 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitra 2025-09-16 13:54:28.101 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.102 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION is disabled or lacking of config 2025-09-16 13:54:28.111 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.121 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 7 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.188 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.192 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.195 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.197 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.201 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.203 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.207 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.210 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.213 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.216 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.219 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:48:27.926, end=2025-09-16T13:53:28.084} 2025-09-16 13:54:28.219 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 5 dubious sqls 2025-09-16 13:54:28.636 INFO 9 --- [prometheus-minute-schedule-1,708b41678b58da74,70218a4e51f2076d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:28.639 INFO 9 --- [prometheus-minute-schedule-1,708b41678b58da74,70218a4e51f2076d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:28.792 INFO 9 --- [ocp-async-5,c7141aa0ea6c3cc2,004770bfd26b32a4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:28.792 WARN 9 --- [ocp-async-1,66673c1bb4cf0887,e85a271f2a0ead0c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:29.055 INFO 9 --- [ocp-schedules-29,64dffbbbb34f5a3d,d2f6b8d17c63e206] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:54:29.057 INFO 9 --- [ocp-schedules-29,64dffbbbb34f5a3d,d2f6b8d17c63e206] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:54:29.938 INFO 9 --- [ocp-schedules-28,06d5f4da86171a67,29930100ca9c34fe] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:54:29.941 INFO 9 --- [ocp-schedules-9,14584cbf92a7a085,fd3db6027eaa8420] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:54:29.941 INFO 9 --- [ocp-schedules-14,6c10256a285bb978,f3603d5a550cf49b] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:54:29.942 INFO 9 --- [ocp-schedules-24,86fbd875f79897ed,d18be4e9e8be961a] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:54:29.943 INFO 9 --- [ocp-schedules-9,14584cbf92a7a085,fd3db6027eaa8420] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:29.943 INFO 9 --- [ocp-schedules-14,6c10256a285bb978,f3603d5a550cf49b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:29.943 INFO 9 --- [ocp-schedules-24,86fbd875f79897ed,d18be4e9e8be961a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:29.943 INFO 9 --- [ocp-schedules-24,86fbd875f79897ed,d18be4e9e8be961a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:54:29.944 INFO 9 --- [ocp-schedules-1,dd180ea99bf041b3,83be9842dd0b71d9] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:54:29.945 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:54:29.945 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:54:29.945 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:54:29.945 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:54:29.945 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:54:29.945 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:54:29.945 INFO 9 --- [ocp-schedules-12,c58c6ffdbf234d06,0fc0e1718070723b] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:54:29.945 INFO 9 --- [host-check-clockdiff1,c58c6ffdbf234d06,eba26ff9d79e7507] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:54:29.945 INFO 9 --- [host-check-clockdiff2,c58c6ffdbf234d06,886e62aab7767f05] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:54:29.945 INFO 9 --- [host-check-clockdiff3,c58c6ffdbf234d06,82d5431ef48dd6fa] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:54:29.945 INFO 9 --- [host-check-clockdiff4,c58c6ffdbf234d06,cdaab081f407b7cb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:54:29.946 INFO 9 --- [ocp-schedules-21,f00e2e4bbbfa0f3b,bad8a9891a1bf34a] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:54:29.946 INFO 9 --- [host-check-clockdiff5,c58c6ffdbf234d06,b69ac237e80526bc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:54:29.946 INFO 9 --- [host-check-agent-status1,f00e2e4bbbfa0f3b,e8b18d07561ecfb8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:54:29.946 INFO 9 --- [host-check-clockdiff6,c58c6ffdbf234d06,92cf7b459b63c684] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:54:29.946 INFO 9 --- [host-check-agent-status2,f00e2e4bbbfa0f3b,647fb13517ffba0f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:54:29.946 INFO 9 --- [host-check-agent-status3,f00e2e4bbbfa0f3b,2fdb802d8b2c31a9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:54:29.946 INFO 9 --- [host-check-agent-status4,f00e2e4bbbfa0f3b,0359eeafd8659a0b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:54:29.946 INFO 9 --- [host-check-agent-status5,f00e2e4bbbfa0f3b,e6b41333c6fad7be] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:54:29.946 INFO 9 --- [host-check-agent-status6,f00e2e4bbbfa0f3b,b7653965f1625069] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:54:29.947 INFO 9 --- [ocp-schedules-27,f424e87b59149759,f261cde292e596c6] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:54:29.949 INFO 9 --- [host-check-clockdiff1,c58c6ffdbf234d06,eba26ff9d79e7507] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002069 -1 -1 , error= 2025-09-16 13:54:29.957 INFO 9 --- [host-check-clockdiff4,c58c6ffdbf234d06,cdaab081f407b7cb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002069 -1 -1 , error= 2025-09-16 13:54:29.957 INFO 9 --- [host-check-clockdiff5,c58c6ffdbf234d06,b69ac237e80526bc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002069 -1 -1 , error= 2025-09-16 13:54:29.958 INFO 9 --- [host-check-clockdiff2,c58c6ffdbf234d06,886e62aab7767f05] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002069 -1 -1 , error= 2025-09-16 13:54:29.959 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:54:29.960 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:54:29.960 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:54:29.960 INFO 9 --- [host-check-clockdiff3,c58c6ffdbf234d06,82d5431ef48dd6fa] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002069 -1 -1 , error= 2025-09-16 13:54:29.960 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:54:29.961 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:54:29.961 INFO 9 --- [host-check-agent-status3,f00e2e4bbbfa0f3b,2fdb802d8b2c31a9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:54:29.961 INFO 9 --- [host-check-agent-status5,f00e2e4bbbfa0f3b,e6b41333c6fad7be] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:54:29.961 INFO 9 --- [host-check-agent-status2,f00e2e4bbbfa0f3b,647fb13517ffba0f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:54:29.961 INFO 9 --- [host-check-agent-status1,f00e2e4bbbfa0f3b,e8b18d07561ecfb8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:54:29.961 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:54:29.961 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:54:29.961 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:54:29.961 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:54:29.961 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:54:29.962 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:29.962 INFO 9 --- [host-check-agent-status5,f00e2e4bbbfa0f3b,e6b41333c6fad7be] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:54:29.962 INFO 9 --- [host-check-agent-status2,f00e2e4bbbfa0f3b,647fb13517ffba0f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:54:29.962 INFO 9 --- [host-check-agent-status3,f00e2e4bbbfa0f3b,2fdb802d8b2c31a9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:54:29.962 INFO 9 --- [host-check-agent-status4,f00e2e4bbbfa0f3b,0359eeafd8659a0b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:54:29.962 INFO 9 --- [host-check-agent-status6,f00e2e4bbbfa0f3b,b7653965f1625069] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:29.962 INFO 9 --- [ocp-schedules-3,cc32c03fb9f9b0a9,7477d494e9de7926] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:54:29.962 INFO 9 --- [host-check-agent-status1,f00e2e4bbbfa0f3b,e8b18d07561ecfb8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:54:29.963 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:29.963 INFO 9 --- [host-check-agent-status4,f00e2e4bbbfa0f3b,0359eeafd8659a0b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:54:29.963 INFO 9 --- [host-check-agent-status6,f00e2e4bbbfa0f3b,b7653965f1625069] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:29.963 INFO 9 --- [ocp-schedules-18,c56db049e0be307b,957a077992782b28] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:54:29.967 INFO 9 --- [ocp-schedules-3,cc32c03fb9f9b0a9,7477d494e9de7926] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:54:29.968 INFO 9 --- [ocp-schedules-18,c56db049e0be307b,957a077992782b28] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:54:29.976 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:54:29.976 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:54:29.976 INFO 9 --- [host-check-agent-status5,f00e2e4bbbfa0f3b,e6b41333c6fad7be] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:54:29.976 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:54:29.977 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:54:29.977 INFO 9 --- [host-check-agent-status6,f00e2e4bbbfa0f3b,b7653965f1625069] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:54:29.977 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:54:29.977 INFO 9 --- [host-check-agent-status1,f00e2e4bbbfa0f3b,e8b18d07561ecfb8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:54:29.978 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:54:29.978 INFO 9 --- [host-check-agent-status2,f00e2e4bbbfa0f3b,647fb13517ffba0f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:54:29.978 INFO 9 --- [host-check-agent-status3,f00e2e4bbbfa0f3b,2fdb802d8b2c31a9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:54:29.978 INFO 9 --- [host-check-agent-status4,f00e2e4bbbfa0f3b,0359eeafd8659a0b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:54:29.978 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:54:29.977491115+08:00 2025-09-16 13:54:29.978 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:54:29.977741401+08:00 2025-09-16 13:54:29.978 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:54:29.977797238+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:54:29.977298681+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:54:29.977647697+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:54:29.978+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:54:29.977833326+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:54:29.978+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:54:29.979+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:54:29.979+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:54:29.979+08:00 2025-09-16 13:54:29.979 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:54:29.979+08:00 2025-09-16 13:54:29.980 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:29.980 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:54:29.978+08:00 and status AVAILABLE 2025-09-16 13:54:29.981 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:54:29.978+08:00 and status AVAILABLE 2025-09-16 13:54:29.981 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:54:29.979+08:00 and status AVAILABLE 2025-09-16 13:54:29.981 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:29.981 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:54:29.979+08:00 and status AVAILABLE 2025-09-16 13:54:29.981 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:54:29.979+08:00 and status AVAILABLE 2025-09-16 13:54:29.981 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:54:29.979+08:00 and status AVAILABLE 2025-09-16 13:54:29.981 INFO 9 --- [host-check-agent-status5,f00e2e4bbbfa0f3b,e6b41333c6fad7be] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:54:29.981 INFO 9 --- [host-check-agent-status5,f00e2e4bbbfa0f3b,e6b41333c6fad7be] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:54:29.981 INFO 9 --- [host-check-agent-status5,f00e2e4bbbfa0f3b,e6b41333c6fad7be] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:54:29.981 INFO 9 --- [host-check-agent-status2,f00e2e4bbbfa0f3b,647fb13517ffba0f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:54:29.981 INFO 9 --- [host-check-agent-status2,f00e2e4bbbfa0f3b,647fb13517ffba0f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:54:29.981 INFO 9 --- [host-check-agent-status2,f00e2e4bbbfa0f3b,647fb13517ffba0f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status6,f00e2e4bbbfa0f3b,b7653965f1625069] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status6,f00e2e4bbbfa0f3b,b7653965f1625069] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status6,f00e2e4bbbfa0f3b,b7653965f1625069] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status3,f00e2e4bbbfa0f3b,2fdb802d8b2c31a9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status1,f00e2e4bbbfa0f3b,e8b18d07561ecfb8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status1,f00e2e4bbbfa0f3b,e8b18d07561ecfb8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status3,f00e2e4bbbfa0f3b,2fdb802d8b2c31a9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status1,f00e2e4bbbfa0f3b,e8b18d07561ecfb8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status3,f00e2e4bbbfa0f3b,2fdb802d8b2c31a9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status4,f00e2e4bbbfa0f3b,0359eeafd8659a0b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status4,f00e2e4bbbfa0f3b,0359eeafd8659a0b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:54:29.982 INFO 9 --- [host-check-agent-status4,f00e2e4bbbfa0f3b,0359eeafd8659a0b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:54:29.983 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:54:29.985 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:54:29.985 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:54:29.985 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:54:29.985 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:54:29.985 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:54:29.986 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:54:29.986 INFO 9 --- [ocp-schedules-14,6c10256a285bb978,f3603d5a550cf49b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:54:29.989 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:54:29.990 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:54:29.990 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:29.991 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:54:29.991 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:54:29.991 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:29.991 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:54:29.992 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:54:29.992 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:54:29.992 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:54:29.992 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:54:29.992 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:54:29.993 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:29.994 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:54:30.005 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:54:30.004627+08:00, lastProcessTime=2025-09-16T13:54:20.003432+08:00 2025-09-16 13:54:30.006 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:30.006 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:30.007 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:30.007 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:30.009 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:30.030 INFO 9 --- [ocp-schedules-29,827d574e245df669,c3cd471ac5d854a0] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:54:30.030 INFO 9 --- [ocp-schedules-29,827d574e245df669,c3cd471ac5d854a0] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:54:30.032 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:54:30.034 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:54:30.034 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:54:30.035 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:30.037 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:54:30.037 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:30.038 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:54:30.038 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:54:30.039 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:54:30.039 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:54:30.041 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:54:30.042 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:54:30.043 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:54:30.045 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:54:30.046 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:54:30.051 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:30.051 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:30.053 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:30.054 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:30.055 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:30.056 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:54:30.072 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:54:30.076 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:30.078 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:54:30.079 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:54:30.079 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:54:30.079 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:30.081 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:54:30.082 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:54:30.084 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:54:30.086 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:54:30.086 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:54:30.086 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:54:30.088 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:54:30.090 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:54:30.090 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:54:30.092 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:54:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:30.098 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:30.100 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:30.101 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:30.101 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:30.101 INFO 9 --- [prometheus-second-schedule-1,6ef239bd0a91ed05,30850129d326f6b3] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:54:30.102 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:30.103 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:54:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:30.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:30.125 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:54:30.127 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:54:30.129 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:54:30.132 INFO 9 --- [host-check-host-status5,dd180ea99bf041b3,b5e67b4cee581d3b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:54:30.132 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:54:30.133 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:54:30.133 INFO 9 --- [host-check-host-status4,dd180ea99bf041b3,8b68cadc1594cce3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:54:30.134 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:54:30.135 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:54:30.004627+08:00 2025-09-16 13:54:30.136 INFO 9 --- [host-check-host-status2,dd180ea99bf041b3,a0d8f2ec2cf70024] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:54:30.139 INFO 9 --- [host-check-host-status1,dd180ea99bf041b3,a364cf80b07373e5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:54:30.139 INFO 9 --- [host-check-host-status6,dd180ea99bf041b3,6c3dab58c111c45c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:54:30.141 INFO 9 --- [host-check-host-status3,dd180ea99bf041b3,f0dccb77b1203e17] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:54:30.142 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.142 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:30.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.156 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:30.184 INFO 9 --- [ocp-async-9,f4966469bfbb458b,5ba90627211eed66] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:54:30.185 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.185 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:30.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:54:30.214 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.214 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:54:30.230 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:54:30.243 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:30.245 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:30.246 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:30.250 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:54:30.253 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:54:30.256 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:30.257 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:30.270 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:54:30.273 INFO 9 --- [ocp-schedules-7,6a00d332c508b65d,b6c1e7130ec182b5] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:54:30.274 INFO 9 --- [ocp-schedules-7,6a00d332c508b65d,b6c1e7130ec182b5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:30.274 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:54:30.274 INFO 9 --- [ocp-schedules-7,6a00d332c508b65d,b6c1e7130ec182b5] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:54:30.329 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:54:30.342 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:30.344 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:30.344 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:54:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:54:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:54:30.358 INFO 9 --- [ocp-schedules-9,14584cbf92a7a085,fd3db6027eaa8420] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:54:30.402 INFO 9 --- [ocp-schedules-28,2632ba62387a416f,7f0823ae7064e5cb] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:54:30.518 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:30.519 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:30.588 INFO 9 --- [ocp-schedules-27,7db8afc91814446d,580d274299366140] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:54:30.590 INFO 9 --- [ocp-schedules-27,7db8afc91814446d,580d274299366140] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:54:30.590 INFO 9 --- [ocp-schedules-27,7db8afc91814446d,580d274299366140] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:54:30.792 WARN 9 --- [ocp-async-10,85521a59aba4ed31,d8e75fe73cea97b6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:30.792 INFO 9 --- [ocp-async-8,18b57b02eba9a4b7,d945cbaf35544091] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:30.846 INFO 9 --- [ocp-schedules-3,8cb429080e9b1c18,1c861cd559f6fab1] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:54:30.887 INFO 9 --- [host-check-clockdiff6,c58c6ffdbf234d06,92cf7b459b63c684] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002070 -2 -2 , error= 2025-09-16 13:54:30.977 INFO 9 --- [ocp-schedules-11,357672edbfc7baef,d0d86047eb0c6166] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:54:30.977 INFO 9 --- [ocp-schedules-11,357672edbfc7baef,d0d86047eb0c6166] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:54:31.154 INFO 9 --- [ocp-schedules-10,730598a224d2386b,431fc9e760c29be8] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:54:31.159 WARN 9 --- [scanner-1376444-1,730598a224d2386b,3448a868e3d5ff7d] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:54:31.475 INFO 9 --- [ocp-schedules-26,6e00464861641da1,4a13f653de6509ae] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:54:31.475 INFO 9 --- [ocp-schedules-26,6e00464861641da1,4a13f653de6509ae] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002071 2025-09-16 13:54:31.475 INFO 9 --- [ocp-schedules-26,6e00464861641da1,4a13f653de6509ae] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:54:31.636 INFO 9 --- [prometheus-minute-schedule-1,5d63e132abe03684,d7e3887928d161d1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:31.640 INFO 9 --- [prometheus-minute-schedule-1,5d63e132abe03684,d7e3887928d161d1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:31.642 INFO 9 --- [ocp-schedules-9,d9f83e4dd153bef5,5808fce83d6ee406] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:54:31.697 INFO 9 --- [ocp-schedules-28,5c52ef7d2a3f8eb1,14a7010a6b95f9f1] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:54:31.698 INFO 9 --- [ocp-schedules-25,64cfcc71249df091,f43270fb1f88b2b1] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:54:31.698 INFO 9 --- [ocp-schedules-25,64cfcc71249df091,f43270fb1f88b2b1] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 13:54:31.699 INFO 9 --- [ocp-schedules-25,64cfcc71249df091,f43270fb1f88b2b1] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:54:31.699 INFO 9 --- [ocp-schedules-25,64cfcc71249df091,f43270fb1f88b2b1] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:54:31.699 INFO 9 --- [ocp-schedules-25,64cfcc71249df091,f43270fb1f88b2b1] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:54:31.699 INFO 9 --- [ocp-schedules-25,64cfcc71249df091,f43270fb1f88b2b1] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:54:31.768 INFO 9 --- [ocp-schedules-30,0d6949569f3c7f58,ac4e7b52b3c97414] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:54:31.769 INFO 9 --- [ocp-schedules-30,0d6949569f3c7f58,ac4e7b52b3c97414] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:31.782 INFO 9 --- [ocp-schedules-30,0d6949569f3c7f58,ac4e7b52b3c97414] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:54:32.792 INFO 9 --- [ocp-async-1,876d83503399a66f,8c4316ed7fc8209d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:32.792 WARN 9 --- [ocp-async-4,fcd556dee42f8e25,c371ba58d3226b60] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:33.424 INFO 9 --- [ocp-schedules-14,93802997bad37be7,49ab53eb4e407309] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:54:33.519 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:33.519 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:33.558 INFO 9 --- [ocp-schedules-18,a1856d03b87983de,37feedec39973787] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:54:33.558+08:00, clusters=[1] 2025-09-16 13:54:33.559 INFO 9 --- [ocp-schedules-18,a1856d03b87983de,37feedec39973787] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:54:34.120 INFO 9 --- [ocp-schedules-12,5e1cbd08670ca00d,714403bc1daaebc8] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:54:34.120 INFO 9 --- [ocp-schedules-12,5e1cbd08670ca00d,714403bc1daaebc8] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:54:34.120 INFO 9 --- [ocp-schedules-12,5e1cbd08670ca00d,714403bc1daaebc8] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:54:34.136 INFO 9 --- [ocp-schedules-12,5e1cbd08670ca00d,714403bc1daaebc8] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:54:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:54:34.636 INFO 9 --- [prometheus-minute-schedule-1,36b51e3503b39413,0fe965bc476ec975] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:34.640 INFO 9 --- [prometheus-minute-schedule-1,36b51e3503b39413,0fe965bc476ec975] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:34.657 INFO 9 --- [ocp-schedules-4,ad00e9ff4796d00c,c8e43b2dafb40077] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:54:34.662 INFO 9 --- [ocp-schedules-4,ad00e9ff4796d00c,c8e43b2dafb40077] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:54:34.662 INFO 9 --- [ocp-schedules-4,ad00e9ff4796d00c,c8e43b2dafb40077] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:54:34.771 INFO 9 --- [ocp-schedules-5,19b33f5240c80a5c,f2ca4eed29eb883f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:54:34.792 INFO 9 --- [ocp-async-7,47daaa0cd2bbd9bf,931e5d67dea49365] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:34.792 WARN 9 --- [ocp-async-6,436738bd00ac7923,076e92007e6fb7f4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:35.604 INFO 9 --- [ocp-schedules-18,f53e354f1c816847,0fccda1e91233e68] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:54:35.604+08:00, clusters=[1] 2025-09-16 13:54:35.608 INFO 9 --- [ocp-schedules-18,f53e354f1c816847,0fccda1e91233e68] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:54:36.519 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:36.520 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:36.792 INFO 9 --- [ocp-async-10,1b94c43bee5732f8,e5fd8d8a66b2ec23] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:36.792 WARN 9 --- [ocp-async-3,75f588cb4c7042e3,20aa65471e2b5a11] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:37.636 INFO 9 --- [prometheus-minute-schedule-1,167e6825d0242b35,830ce2b35a00c59a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:37.639 INFO 9 --- [prometheus-minute-schedule-1,167e6825d0242b35,830ce2b35a00c59a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:37.805 INFO 9 --- [ocp-schedules-11,281ef58830074fb8,7bc1682606320dfb] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:54:37.806 INFO 9 --- [ocp-schedules-11,281ef58830074fb8,7bc1682606320dfb] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:37.827 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:37.828 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:54:37.840 INFO 9 --- [ocp-schedules-11,281ef58830074fb8,7bc1682606320dfb] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:54:38.792 WARN 9 --- [ocp-async-9,a79f4ac6ae6b0bff,ccbfb82fe62c9beb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:38.792 INFO 9 --- [ocp-async-4,2895f7f7abd6d5f2,7c54c4f2b4f2e551] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:39.062 INFO 9 --- [ocp-schedules-3,321d74778995dfac,65871c4d20de29f7] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:54:39.064 INFO 9 --- [ocp-schedules-3,321d74778995dfac,65871c4d20de29f7] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:54:39.520 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:39.521 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:39.866 INFO 9 --- [ocp-schedules-18,d1355ff5c6ee8c66,6d2b36f362f54ccc] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:54:39.866 INFO 9 --- [ocp-schedules-18,d1355ff5c6ee8c66,6d2b36f362f54ccc] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:54:39.878 INFO 9 --- [ocp-schedules-5,f4b6ee7a32c4c257,0db19b12e95a267e] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:54:39.878 INFO 9 --- [ocp-schedules-5,f4b6ee7a32c4c257,0db19b12e95a267e] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:54:39.878 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:54:39.878 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:54:39.878 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:54:39.878 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:54:39.882 INFO 9 --- [ocp-schedules-5,f4b6ee7a32c4c257,0db19b12e95a267e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:54:39.882 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:54:39.882 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:39.882 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:54:39.882 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:54:39.882 INFO 9 --- [ocp-schedules-5,f4b6ee7a32c4c257,0db19b12e95a267e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:54:39.883 INFO 9 --- [Collect all tenants major compactions1,d1355ff5c6ee8c66,c7bd633c4d8dc55f] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:54:39.883 INFO 9 --- [Collect all tenants major compactions2,d1355ff5c6ee8c66,404472b7f35cadcf] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:54:39.883 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:54:39.883 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:39.883 INFO 9 --- [Collect all tenants major compactions3,d1355ff5c6ee8c66,6f5a4181e15bb697] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:54:39.883 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:54:39.883 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:54:39.897 INFO 9 --- [ocp-schedules-5,f4b6ee7a32c4c257,0db19b12e95a267e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:54:39.897 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:54:39.898 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:54:39.898 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:54:39.898 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:54:39.899 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:54:39.901 INFO 9 --- [Collect all tenants major compactions3,d1355ff5c6ee8c66,6f5a4181e15bb697] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:39.902 INFO 9 --- [Collect all tenants major compactions2,d1355ff5c6ee8c66,404472b7f35cadcf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:39.902 INFO 9 --- [Collect all tenants major compactions1,d1355ff5c6ee8c66,c7bd633c4d8dc55f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:39.902 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:54:39.903 INFO 9 --- [Collect all tenants major compactions1,d1355ff5c6ee8c66,c7bd633c4d8dc55f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:54:39.903 INFO 9 --- [Collect all tenants major compactions3,d1355ff5c6ee8c66,6f5a4181e15bb697] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:54:39.903 INFO 9 --- [Collect all tenants major compactions2,d1355ff5c6ee8c66,404472b7f35cadcf] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:54:39.903 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:54:39.907 INFO 9 --- [Collect all tenants major compactions1,d1355ff5c6ee8c66,c7bd633c4d8dc55f] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:54:39.907 INFO 9 --- [Collect all tenants major compactions3,d1355ff5c6ee8c66,6f5a4181e15bb697] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:54:39.908 INFO 9 --- [Collect all tenants major compactions2,d1355ff5c6ee8c66,404472b7f35cadcf] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:54:39.909 INFO 9 --- [ocp-schedules-18,d1355ff5c6ee8c66,6d2b36f362f54ccc] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:54:39.916 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:54:39.918 INFO 9 --- [ocp-schedules-5,f4b6ee7a32c4c257,0db19b12e95a267e] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:54:40.001 INFO 9 --- [ocp-schedules-12,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:54:40.002 INFO 9 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:54:40.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:54:40.003658+08:00, lastProcessTime=2025-09-16T13:54:30.004627+08:00 2025-09-16 13:54:40.116 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:54:40.003658+08:00 2025-09-16 13:54:40.184 INFO 9 --- [ocp-async-2,9de7bb0a56f5e716,31b43ebb43907ee4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:54:40.636 INFO 9 --- [prometheus-minute-schedule-1,d5e20e52f20a305c,34ceb5266b10b5bf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:40.639 INFO 9 --- [prometheus-minute-schedule-1,d5e20e52f20a305c,34ceb5266b10b5bf] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:40.792 INFO 9 --- [ocp-async-5,181d32f5988bc2d2,51d3f23a3329fcd4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:40.792 WARN 9 --- [ocp-async-3,fe567f27b2646092,5df371c8e331ff68] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:41.182 INFO 9 --- [ocp-schedules-18,509ae4a4f064578e,71cc0bf6b78726c0] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:54:41.186 WARN 9 --- [scanner-1376571-1,509ae4a4f064578e,64b64d2a386210b3] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:54:42.336 INFO 9 --- [ocp-schedules-22,7160888a6379ad4f,e9f1c5f8de189a52] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:54:42.336 INFO 9 --- [ocp-schedules-22,7160888a6379ad4f,e9f1c5f8de189a52] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:54:42.371 INFO 9 --- [ocp-schedules-22,7160888a6379ad4f,e9f1c5f8de189a52] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:42.372 INFO 9 --- [ocp-schedules-22,7160888a6379ad4f,e9f1c5f8de189a52] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:54:42.521 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:42.522 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:42.793 INFO 9 --- [ocp-async-2,4c259bec821e862d,7cf184d7e0ebc2b9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:42.793 WARN 9 --- [ocp-async-9,3054fdb4ca175633,721f7d9816c9e59f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:43.636 INFO 9 --- [prometheus-minute-schedule-1,066259f62b8143ba,f9035ae20a4f3f93] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:43.639 INFO 9 --- [prometheus-minute-schedule-1,066259f62b8143ba,f9035ae20a4f3f93] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:44.704 INFO 9 --- [ocp-schedules-25,64306014ea594dbe,d81185de2d5dae63] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:54:44.705 INFO 9 --- [ocp-schedules-25,64306014ea594dbe,d81185de2d5dae63] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:44.754 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:54:44.754 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.757 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:54:44.775 INFO 9 --- [ocp-schedules-27,a13a723bc8c55945,47793ab82640a190] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:54:44.784 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.785 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:54:44.793 INFO 9 --- [ocp-async-8,cc2b7d95b1c9ca1b,690c2fb7c06142be] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:44.793 WARN 9 --- [ocp-async-1,5fa87c3d04c14d20,7ef7ca8058ca13db] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:44.808 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.809 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:54:44.832 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.832 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:54:44.837 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.837 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:54:44.861 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.862 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:54:44.885 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.886 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:54:44.890 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.891 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:54:44.914 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.915 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:54:44.937 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.937 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:54:44.953 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.953 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:54:44.954 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.955 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:54:44.956 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.956 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:54:44.957 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.958 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:54:44.958 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.959 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:54:44.960 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.960 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:54:44.975 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.976 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:54:44.977 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.978 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:54:44.978 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:44.979 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:54:44.993 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:54:44.994 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:54:45.020 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:54:45.022 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:45.022 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:54:45.050 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:54:45.050 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:54:45.050 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:54:45.050 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:54:45.050 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:54:45.050 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:54:45.052 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:54:45.052 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:54:45.052 INFO 9 --- [ocp-schedules-25,64306014ea594dbe,d81185de2d5dae63] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:54:45.522 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:45.523 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 13:54:45,970 |-INFO in ReconfigureOnChangeTask(born:1758001965970) - Empty watch file list. Disabling 2025-09-16 13:54:46.636 INFO 9 --- [prometheus-minute-schedule-1,bb79dc22318d4218,fb783158910f45fb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:46.639 INFO 9 --- [prometheus-minute-schedule-1,bb79dc22318d4218,fb783158910f45fb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:46.793 INFO 9 --- [ocp-async-6,d25a3e5d71f6cad9,f913e34d60ded789] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:46.793 WARN 9 --- [ocp-async-7,cfe1a58f4ea575c8,94b5e226ea9aaeda] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:48.523 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:48.524 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:48.793 INFO 9 --- [ocp-async-5,533b2262487fb3e5,914c4550d2fa8c4f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:48.793 WARN 9 --- [ocp-async-10,f4df3703ef15878c,95820aabeb3e63cd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:49.069 INFO 9 --- [ocp-schedules-18,9f7dba1f64c0806f,d1b6aa7366b5addb] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:54:49.071 INFO 9 --- [ocp-schedules-18,9f7dba1f64c0806f,d1b6aa7366b5addb] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:54:49.223 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:54:49.238 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:54:49.253 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:54:49.253 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:54:49.253 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:54:49.253 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:54:49.253 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:54:49.257 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.257 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.257 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.257 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.258 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:49.258 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:49.258 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:49.258 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:54:49.259 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:54:49.261 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.261 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:49.263 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:49.263 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:54:49.285 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:50:00, end=2025-09-16T13:52:30, updates=73, granule=120000ms, delay=150000ms 2025-09-16 13:54:49.289 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:50:00, end=2025-09-16T13:52:30, updates=70, granule=120000ms, delay=150000ms 2025-09-16 13:54:49.291 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:50:00, end=2025-09-16T13:52:30, updates=144, granule=120000ms, delay=150000ms 2025-09-16 13:54:49.292 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:52:30, granule=120000ms, delay=0ms) 2025-09-16 13:54:49.293 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:50:00, end=2025-09-16T13:52:30, updates=105, granule=120000ms, delay=150000ms 2025-09-16 13:54:49.294 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:52:30, granule=120000ms, delay=0ms) 2025-09-16 13:54:49.295 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:52:30, granule=120000ms, delay=0ms) 2025-09-16 13:54:49.299 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:52:30, granule=120000ms, delay=0ms) 2025-09-16 13:54:49.300 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:50:00, end=2025-09-16T13:52:30, updates=188, granule=120000ms, delay=150000ms 2025-09-16 13:54:49.304 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:52:30, granule=120000ms, delay=0ms) 2025-09-16 13:54:49.313 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=1->2, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:37:30, end=2025-09-16T13:47:30, updates=96, granule=600000ms, delay=900000ms 2025-09-16 13:54:49.313 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=1->2, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:37:30, end=2025-09-16T13:47:30, updates=102, granule=600000ms, delay=900000ms 2025-09-16 13:54:49.317 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:54:49.319 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:54:49.321 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=1->2, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:37:30, end=2025-09-16T13:47:30, updates=201, granule=600000ms, delay=900000ms 2025-09-16 13:54:49.326 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:54:49.329 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=1->2, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:37:30, end=2025-09-16T13:47:30, updates=242, granule=600000ms, delay=900000ms 2025-09-16 13:54:49.334 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:54:49.336 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=1->2, c=0) - source=2025-09-16T13:52:30, start=2025-09-16T13:37:30, end=2025-09-16T13:47:30, updates=237, granule=600000ms, delay=900000ms 2025-09-16 13:54:49.339 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=1) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:54:49.339 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=116ms, period=120000ms 2025-09-16 13:54:49.636 INFO 9 --- [prometheus-minute-schedule-1,9535cef12e488f1f,475e7d03cfa04060] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:49.639 INFO 9 --- [prometheus-minute-schedule-1,9535cef12e488f1f,475e7d03cfa04060] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:54:50.003209+08:00, lastProcessTime=2025-09-16T13:54:40.003658+08:00 2025-09-16 13:54:50.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:54:50.003209+08:00 2025-09-16 13:54:50.184 INFO 9 --- [ocp-async-7,e2cf5d3b0c825649,60ca3dd8f92b1c5a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:54:50.793 INFO 9 --- [ocp-async-1,49c8bc4ad4100292,00e6a07eee1d1655] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:50.793 WARN 9 --- [ocp-async-8,d72a64c07ab8b511,c945f2ff01e5276c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:51.212 INFO 9 --- [ocp-schedules-10,8a8b6ead990a7b87,774f05a67d4f6273] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:54:51.217 WARN 9 --- [scanner-1376732-1,8a8b6ead990a7b87,c1e5be15b41255b3] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:54:51.524 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:51.525 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:52.636 INFO 9 --- [prometheus-minute-schedule-1,a5ee8bd576f1a432,5c6e1ed96cce0cd6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:52.639 INFO 9 --- [prometheus-minute-schedule-1,a5ee8bd576f1a432,5c6e1ed96cce0cd6] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:52.793 INFO 9 --- [ocp-async-7,6c94a5655f093216,6895e15aaab4ddb6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:52.793 WARN 9 --- [ocp-async-6,a1f3dba61b400b80,9963961e0d6d7165] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:54.525 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:54.525 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:54.664 INFO 9 --- [ocp-schedules-30,7c6610d872260135,71814686523725ae] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:54:54.668 INFO 9 --- [ocp-schedules-30,7c6610d872260135,71814686523725ae] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:54:54.668 INFO 9 --- [ocp-schedules-30,7c6610d872260135,71814686523725ae] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:54:54.779 INFO 9 --- [ocp-schedules-22,0ee6af7b88c072bf,627e211313c74722] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:54:54.793 INFO 9 --- [ocp-async-10,aa7dbc5997d36ba2,302c8f1ad3e1b9aa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:54.793 WARN 9 --- [ocp-async-5,0feff93179186c3e,ee25685e06ddfd95] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:55.636 INFO 9 --- [prometheus-minute-schedule-1,1f2a47c385f2a014,6c158438e21aa239] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:55.639 INFO 9 --- [prometheus-minute-schedule-1,1f2a47c385f2a014,6c158438e21aa239] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:56.793 INFO 9 --- [ocp-async-2,0181b9e4ba0deb03,f451976c02d8ce7b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:56.793 WARN 9 --- [ocp-async-4,c6381a8427ec266c,cfa867cedb4814db] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:57.525 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:54:57.526 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:54:58.636 INFO 9 --- [prometheus-minute-schedule-1,0929f0729b4a1fc6,be69e98ecf82b39b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002100, interval=60 2025-09-16 13:54:58.639 INFO 9 --- [prometheus-minute-schedule-1,0929f0729b4a1fc6,be69e98ecf82b39b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:54:58.793 INFO 9 --- [ocp-async-1,b6cc728623d5113b,618bde393e4be916] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:54:58.793 WARN 9 --- [ocp-async-3,4e9eaa3dec9105c2,dec980a9af7df779] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:54:59.076 INFO 9 --- [ocp-schedules-10,bcff32d180e36af5,f79b277f493828aa] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:54:59.078 INFO 9 --- [ocp-schedules-10,bcff32d180e36af5,f79b277f493828aa] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:54:59.938 INFO 9 --- [ocp-schedules-2,1e7813cc19f9ac58,1964726a778640c0] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:54:59.941 INFO 9 --- [ocp-schedules-24,1548f3dd24944ed0,cdd9e30321d93bb0] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:54:59.941 INFO 9 --- [ocp-schedules-23,24703696379bf029,f8d9fe26d5b1505b] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:54:59.942 INFO 9 --- [ocp-schedules-12,a6ba83e2f5ed619a,9652342703f7d15e] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:54:59.942 INFO 9 --- [ocp-schedules-24,1548f3dd24944ed0,cdd9e30321d93bb0] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:59.942 INFO 9 --- [ocp-schedules-23,24703696379bf029,f8d9fe26d5b1505b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:59.943 INFO 9 --- [ocp-schedules-12,a6ba83e2f5ed619a,9652342703f7d15e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:54:59.944 INFO 9 --- [ocp-schedules-12,a6ba83e2f5ed619a,9652342703f7d15e] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:54:59.945 INFO 9 --- [ocp-schedules-14,c7f1ce1a976e2538,563df6fb3c2c41f0] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:54:59.945 INFO 9 --- [ocp-schedules-22,18655eec9b12c17c,6f5447d159441b3d] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:54:59.945 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-agent-status1,18655eec9b12c17c,ac6876a851237c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-agent-status2,18655eec9b12c17c,a87675a8e295ffab] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-agent-status3,18655eec9b12c17c,91064ed3946cb69c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-agent-status4,18655eec9b12c17c,b437e50f66be360a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-agent-status5,18655eec9b12c17c,4283a1bb9dc34d26] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-agent-status6,18655eec9b12c17c,7b7795889758943f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:54:59.945 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:54:59.946 INFO 9 --- [ocp-schedules-9,7c60b5a64a6daba9,ecf039c1456928b9] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:54:59.946 INFO 9 --- [host-check-clockdiff1,7c60b5a64a6daba9,b138d125a5a81344] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:54:59.946 INFO 9 --- [host-check-clockdiff2,7c60b5a64a6daba9,e6d8b4ccfc897889] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:54:59.946 INFO 9 --- [host-check-clockdiff3,7c60b5a64a6daba9,5e0c4c0ff8a13426] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:54:59.946 INFO 9 --- [host-check-clockdiff4,7c60b5a64a6daba9,94f5e2072c97cbcc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:54:59.946 INFO 9 --- [host-check-clockdiff5,7c60b5a64a6daba9,0e4da4fcadb8c82c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:54:59.946 INFO 9 --- [host-check-clockdiff6,7c60b5a64a6daba9,8b50e48ad73f3d12] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:54:59.947 INFO 9 --- [ocp-schedules-17,753e9078a326ca71,e1dfb80b0cd59384] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:54:59.952 INFO 9 --- [host-check-clockdiff1,7c60b5a64a6daba9,b138d125a5a81344] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002099 -1 -1 , error= 2025-09-16 13:54:59.954 INFO 9 --- [host-check-clockdiff5,7c60b5a64a6daba9,0e4da4fcadb8c82c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002099 -1 -1 , error= 2025-09-16 13:54:59.955 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:54:59.955 INFO 9 --- [host-check-clockdiff2,7c60b5a64a6daba9,e6d8b4ccfc897889] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002099 -1 -1 , error= 2025-09-16 13:54:59.956 INFO 9 --- [host-check-agent-status4,18655eec9b12c17c,b437e50f66be360a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:54:59.956 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:54:59.956 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:54:59.956 INFO 9 --- [host-check-agent-status6,18655eec9b12c17c,7b7795889758943f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:59.956 INFO 9 --- [host-check-agent-status3,18655eec9b12c17c,91064ed3946cb69c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:54:59.956 INFO 9 --- [host-check-agent-status1,18655eec9b12c17c,ac6876a851237c8f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:54:59.956 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:54:59.956 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:54:59.956 INFO 9 --- [host-check-agent-status5,18655eec9b12c17c,4283a1bb9dc34d26] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:54:59.956 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:59.957 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:54:59.957 INFO 9 --- [host-check-agent-status4,18655eec9b12c17c,b437e50f66be360a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:54:59.957 INFO 9 --- [host-check-agent-status3,18655eec9b12c17c,91064ed3946cb69c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:54:59.957 INFO 9 --- [host-check-agent-status6,18655eec9b12c17c,7b7795889758943f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:59.957 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:54:59.957 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:54:59.957 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:54:59.957 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:54:59.957 INFO 9 --- [host-check-agent-status1,18655eec9b12c17c,ac6876a851237c8f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:54:59.957 INFO 9 --- [host-check-agent-status5,18655eec9b12c17c,4283a1bb9dc34d26] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:54:59.957 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:59.959 INFO 9 --- [host-check-agent-status2,18655eec9b12c17c,a87675a8e295ffab] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:54:59.960 INFO 9 --- [host-check-agent-status2,18655eec9b12c17c,a87675a8e295ffab] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:54:59.971 INFO 9 --- [host-check-agent-status6,18655eec9b12c17c,7b7795889758943f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:54:59.971 INFO 9 --- [host-check-agent-status4,18655eec9b12c17c,b437e50f66be360a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:54:59.971 INFO 9 --- [host-check-agent-status5,18655eec9b12c17c,4283a1bb9dc34d26] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:54:59.971 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:54:59.971 INFO 9 --- [host-check-agent-status1,18655eec9b12c17c,ac6876a851237c8f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:54:59.971 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:54:59.972 INFO 9 --- [host-check-agent-status3,18655eec9b12c17c,91064ed3946cb69c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:54:59.972 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:54:59.973 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:54:59.973 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:54:59.973 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:54:59.973 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:54:59.972306194+08:00 2025-09-16 13:54:59.973 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:54:59.972124180+08:00 2025-09-16 13:54:59.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:59.974 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:54:59.973+08:00 2025-09-16 13:54:59.974 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:54:59.973+08:00 2025-09-16 13:54:59.974 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:54:59.972776905+08:00 2025-09-16 13:54:59.974 INFO 9 --- [host-check-agent-status2,18655eec9b12c17c,a87675a8e295ffab] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:54:59.974 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:54:59.972897057+08:00 2025-09-16 13:54:59.974 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:54:59.973598468+08:00 2025-09-16 13:54:59.974 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:54:59.974+08:00 2025-09-16 13:54:59.975 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:54:59.974+08:00 2025-09-16 13:54:59.975 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:54:59.974+08:00 2025-09-16 13:54:59.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:54:59.975 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:54:59.973997716+08:00 2025-09-16 13:54:59.975 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:54:59.975+08:00 2025-09-16 13:54:59.975 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:54:59.973+08:00 and status AVAILABLE 2025-09-16 13:54:59.975 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:54:59.973+08:00 and status AVAILABLE 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status5,18655eec9b12c17c,4283a1bb9dc34d26] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status5,18655eec9b12c17c,4283a1bb9dc34d26] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status5,18655eec9b12c17c,4283a1bb9dc34d26] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status4,18655eec9b12c17c,b437e50f66be360a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status1,18655eec9b12c17c,ac6876a851237c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status4,18655eec9b12c17c,b437e50f66be360a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status4,18655eec9b12c17c,b437e50f66be360a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status1,18655eec9b12c17c,ac6876a851237c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status1,18655eec9b12c17c,ac6876a851237c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status6,18655eec9b12c17c,7b7795889758943f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status6,18655eec9b12c17c,7b7795889758943f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status6,18655eec9b12c17c,7b7795889758943f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status3,18655eec9b12c17c,91064ed3946cb69c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status3,18655eec9b12c17c,91064ed3946cb69c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:54:59.976 INFO 9 --- [host-check-agent-status3,18655eec9b12c17c,91064ed3946cb69c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:54:59.976 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:54:59.974+08:00 and status AVAILABLE 2025-09-16 13:54:59.976 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:54:59.974+08:00 and status AVAILABLE 2025-09-16 13:54:59.976 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:54:59.974+08:00 and status AVAILABLE 2025-09-16 13:54:59.977 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:54:59.975+08:00 and status AVAILABLE 2025-09-16 13:54:59.978 INFO 9 --- [host-check-agent-status2,18655eec9b12c17c,a87675a8e295ffab] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:54:59.978 INFO 9 --- [host-check-agent-status2,18655eec9b12c17c,a87675a8e295ffab] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:54:59.978 INFO 9 --- [host-check-agent-status2,18655eec9b12c17c,a87675a8e295ffab] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:54:59.978 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:54:59.979 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:54:59.980 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:54:59.980 INFO 9 --- [ocp-schedules-23,24703696379bf029,f8d9fe26d5b1505b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:54:59.980 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:54:59.980 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:54:59.980 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:54:59.980 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:54:59.984 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:54:59.984 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:54:59.985 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:54:59.985 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:54:59.986 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:54:59.986 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:54:59.986 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:54:59.986 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:54:59.986 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:54:59.986 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:54:59.987 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:54:59.987 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:54:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:54:59.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:54:59.999 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:54:59.999 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:00.000 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:00.000 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:00.000 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:00.000 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:55:00.003799+08:00, lastProcessTime=2025-09-16T13:54:50.003209+08:00 2025-09-16 13:55:00.026 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:55:00.027 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:00.027 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:55:00.028 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:55:00.028 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:55:00.028 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:55:00.028 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:00.029 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:55:00.030 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:55:00.033 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:55:00.034 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:55:00.034 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:55:00.034 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:55:00.035 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:55:00.037 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:55:00.046 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:00.047 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:00.047 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:00.047 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:00.047 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:00.047 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:00.064 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:00.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:00.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:55:00.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:55:00.073 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:55:00.073 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:00.074 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:55:00.075 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:55:00.075 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:55:00.075 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:55:00.075 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:55:00.079 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:55:00.081 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:55:00.082 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:55:00.082 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:55:00.082 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:55:00.082 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:55:00.088 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.088 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:00.092 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:00.093 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:00.093 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:00.093 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:00.095 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:00.095 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:00.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.103 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:00.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.117 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:00.119 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:55:00.121 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:55:00.121 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:55:00.121 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:55:00.122 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:55:00.126 INFO 9 --- [host-check-host-status5,c7f1ce1a976e2538,d11d4e779c971b54] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:55:00.126 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:55:00.128 INFO 9 --- [host-check-host-status1,c7f1ce1a976e2538,0e9b02c544c5afcd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:55:00.128 INFO 9 --- [host-check-host-status2,c7f1ce1a976e2538,2fa0ba25e745b004] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:55:00.128 INFO 9 --- [host-check-host-status3,c7f1ce1a976e2538,77780a03996ee944] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:55:00.129 INFO 9 --- [host-check-host-status4,c7f1ce1a976e2538,33d6035c645039be] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:55:00.129 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:55:00.003799+08:00 2025-09-16 13:55:00.133 INFO 9 --- [host-check-host-status6,c7f1ce1a976e2538,4f4b0fba55379179] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:55:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:00.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:00.184 INFO 9 --- [ocp-async-10,d30c72104deea638,044e72bb6620c2b0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:55:00.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:00.221 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:00.235 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:00.236 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:00.237 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:55:00.242 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:55:00.245 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:55:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:55:00.322 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:55:00.336 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:00.338 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:00.339 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:55:00.353 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:55:00.353 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:55:00.353 INFO 9 --- [ocp-schedules-24,1548f3dd24944ed0,cdd9e30321d93bb0] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:55:00.504 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:50:01.0, nextRun=2025-09-16 13:55:00.0, currentDate=Tue Sep 16 13:55:00 CST 2025 2025-09-16 13:55:00.504 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999977, name=DiagFuncUpdateSchedule, templateName=DiagFuncUpdateSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:50:01.0, nextRunTime=2025-09-16 13:55:00.0} 2025-09-16 13:55:00.507 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=DiagFuncUpdateSchedule, nodeCount=1, taskCount=1 2025-09-16 13:55:00.507 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='DiagFuncUpdateSchedule', taskDefinitionId=999977, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T13:55:00.507+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Update diag function, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.diagnosis.task.DiagFuncUpdateTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 13:55:00.519 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:50:01.0, nextRun=2025-09-16 13:55:00.0, currentDate=Tue Sep 16 13:55:00 CST 2025 2025-09-16 13:55:00.519 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:50:01.0, nextRunTime=2025-09-16 13:55:00.0} 2025-09-16 13:55:00.526 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:00.527 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:00.531 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[1] 2025-09-16 13:55:00.538 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.p.s.internal.SqlParseTaskSchedule : HighRiskSql Parse is ready 2025-09-16 13:55:00.540 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=SqlParseTaskSchedule, nodeCount=1, taskCount=1 2025-09-16 13:55:00.540 INFO 9 --- [task-coordinator3,25e389618b93fdc9,de9d2d8193006cb5] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='SqlParseTaskSchedule', taskDefinitionId=999985, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={cluster_ids=[[1]]}}, createTime=null, startTime=2025-09-16T13:55:00.540+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Sql Parse Task, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.task.SqlParseTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 13:55:00.756 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,f5c2162b20008752] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1347, operation:EXECUTE, state: RUNNING 2025-09-16 13:55:00.763 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,f5c2162b20008752] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1348, operation:EXECUTE, state: RUNNING 2025-09-16 13:55:00.768 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 13:55:00.768 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1347, context=Context{parallelIdx=-1, stringMap={task_instance_id=820, task_operation=execute, latest_execution_start_time=2025-09-16T13:55:00.736+08:00, sub_task_instance_name=Update diag function, sub_task_instance_id=1347}, listMap={}}, executor=10.233.116.22 2025-09-16 13:55:00.773 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 13:55:00.775 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1348, context=Context{parallelIdx=0, stringMap={subtask_splitter=cluster_ids, task_instance_id=821, task_operation=execute, latest_execution_start_time=2025-09-16T13:55:00.761+08:00, sub_task_instance_name=Sql Parse Task, sub_task_instance_id=1348}, listMap={cluster_ids=[[1]]}}, executor=10.233.116.22 2025-09-16 13:55:00.775 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.o.p.sql.internal.task.SqlParseTask : parse sql for cluster:1 2025-09-16 13:55:00.783 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:00.794 INFO 9 --- [ocp-async-7,9ae0de24525a08c0,c55b05d044969e78] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:00.794 WARN 9 --- [ocp-async-9,59a975f9cb7e1e51,3d9c15f2845b90ad] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:00.819 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1002,1757980800000000,2000,30000000 2025-09-16 13:55:00.824 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.o.perf.sql.internal.SqlParseService : parse 2 sqls for tenant:ObTenantEntity{id=2, name=cos, obTenantId=1002, status=NORMAL} 2025-09-16 13:55:00.845 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:00.848 INFO 9 --- [ocp-schedules-17,6217a26bb37698aa,1cec8d4c326dd499] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:55:00.882 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:00.891 INFO 9 --- [host-check-clockdiff3,7c60b5a64a6daba9,5e0c4c0ff8a13426] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002100 -1 -1 , error= 2025-09-16 13:55:00.891 INFO 9 --- [host-check-clockdiff6,7c60b5a64a6daba9,8b50e48ad73f3d12] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002100 -1 -1 , error= 2025-09-16 13:55:00.923 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:00.952 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:00.953 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1004,1757980800000000,2000,30000000 2025-09-16 13:55:00.956 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.o.perf.sql.internal.SqlParseService : parse 0 sqls for tenant:ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL} 2025-09-16 13:55:00.960 INFO 9 --- [subtask-executor31,25e389618b93fdc9,2391fb11e9eafbb2] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1348, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 13:55:00.984 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:01.007 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:01.017 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.o.DiskUsageTimeRemainingOperator : no metrics data, skip predicting for zhengqi 2025-09-16 13:55:01.018 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 13:55:01.064 INFO 9 --- [subtask-executor30,25e389618b93fdc9,b90347e4a87d6e68] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1347, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 13:55:01.088 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:820, status:SUCCESS 2025-09-16 13:55:01.089 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:820, status:SUCCESS 2025-09-16 13:55:01.094 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:821, status:SUCCESS 2025-09-16 13:55:01.094 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:821, status:SUCCESS 2025-09-16 13:55:01.237 INFO 9 --- [ocp-schedules-18,96483b6cde3d7a78,13051dcc855ff86b] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:55:01.243 WARN 9 --- [scanner-1376952-1,96483b6cde3d7a78,69fc2a0f40ea5937] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:55:01.636 INFO 9 --- [prometheus-minute-schedule-1,92058892fb353be5,8ca6451e1c6dcf3d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:01.639 INFO 9 --- [prometheus-minute-schedule-1,92058892fb353be5,8ca6451e1c6dcf3d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:01.731 INFO 9 --- [host-check-clockdiff4,7c60b5a64a6daba9,94f5e2072c97cbcc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002101 -1 -1 , error= 2025-09-16 13:55:02.794 INFO 9 --- [ocp-async-7,f613988bc6b7fec4,10f0708c865d436d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:02.794 WARN 9 --- [ocp-async-8,6f3a76b23e569b82,d49639f9244cb085] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:03.527 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:03.527 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:04.636 INFO 9 --- [prometheus-minute-schedule-1,e66fd936ad27bc23,e9f021c8ddbc5fa5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:04.639 INFO 9 --- [prometheus-minute-schedule-1,e66fd936ad27bc23,e9f021c8ddbc5fa5] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:04.782 INFO 9 --- [ocp-schedules-26,65b45264e4d062c6,7cf711242af7e2b3] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:55:04.794 INFO 9 --- [ocp-async-7,baddb0305cd3d97e,dcb13427cc6825a3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:04.794 WARN 9 --- [ocp-async-6,d4370c69f8e8a606,d5c5820054d70ffb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:06.527 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:06.528 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:06.794 INFO 9 --- [ocp-async-7,6dc7d31c33757662,7570a42f3c90189b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:06.794 WARN 9 --- [ocp-async-4,406018d72fb6814b,f3c9f6e2811e5910] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:07.636 INFO 9 --- [prometheus-minute-schedule-1,0f5a6e39565075e6,5c147a65190dbdce] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:07.639 INFO 9 --- [prometheus-minute-schedule-1,0f5a6e39565075e6,5c147a65190dbdce] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:08.794 INFO 9 --- [ocp-async-7,4d7d5346b4a10aac,f09bdfea7febf5ac] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:08.794 WARN 9 --- [ocp-async-2,1234a4ae2e11730a,66ad6bab3af61a4b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:09.083 INFO 9 --- [ocp-schedules-27,c087c95ec2a59f7c,6218621adb42f6e9] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:55:09.085 INFO 9 --- [ocp-schedules-27,c087c95ec2a59f7c,6218621adb42f6e9] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:55:09.528 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:09.529 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:10.002 INFO 9 --- [ocp-schedules-15,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:55:10.002 INFO 9 --- [ocp-schedules-12,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:55:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:55:10.003478+08:00, lastProcessTime=2025-09-16T13:55:00.003799+08:00 2025-09-16 13:55:10.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:55:10.003478+08:00 2025-09-16 13:55:10.184 INFO 9 --- [ocp-async-4,1ab6ab8781fc2667,c44633b49e90d96c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:55:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:55:10.636 INFO 9 --- [prometheus-minute-schedule-1,21be68bf40432ddc,e22f4f295613757b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:10.639 INFO 9 --- [prometheus-minute-schedule-1,21be68bf40432ddc,e22f4f295613757b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:10.794 INFO 9 --- [ocp-async-6,b2c6a527fecce384,ce7acdc52f52185e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:10.794 WARN 9 --- [ocp-async-1,c81863ba1b8c8069,69d790371cffeb1f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:11.268 INFO 9 --- [ocp-schedules-10,317b90ea299a8daa,cd58f76958405c60] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:55:11.273 WARN 9 --- [scanner-1377995-1,317b90ea299a8daa,920108c80a57b0ce] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:55:11.739 INFO 9 --- [metric-archive-async-2,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002040, nodeCount=463, affectRows=463 2025-09-16 13:55:12.418 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,60873fad7ba4cd4a,f5c1fbb66786f957] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=60873fad7ba4cd4a, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:55:12.418 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,60873fad7ba4cd4a,f5c1fbb66786f957] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=60873fad7ba4cd4a, duration=1 ms] 2025-09-16 13:55:12.529 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:12.530 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:12.794 INFO 9 --- [ocp-async-4,b4bf952523d049cf,ae0b8ee0ed385d44] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:12.794 WARN 9 --- [ocp-async-5,210a937692663ebc,a96d598e13989ced] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:13.123 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002040, nodeCount=1000, affectRows=1000 2025-09-16 13:55:13.125 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002040, nodeCount=1000, validCount=997 2025-09-16 13:55:13.130 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002040, nodeCount=1000, affectRows=1000 2025-09-16 13:55:13.132 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002040, nodeCount=1000, validCount=997 2025-09-16 13:55:13.136 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697862) Duplicate entry '824147022748467200-1758001980' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697862) Duplicate entry '824147022748467200-1758001980' for key 'PRIMARY' 2025-09-16 13:55:13.155 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002040, nodeCount=853, affectRows=853 2025-09-16 13:55:13.157 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002040, nodeCount=853, validCount=849 2025-09-16 13:55:13.636 INFO 9 --- [prometheus-minute-schedule-1,0018e00142875987,9b748be44aa3eb4b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:13.640 INFO 9 --- [prometheus-minute-schedule-1,0018e00142875987,9b748be44aa3eb4b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:14.403 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002040, nodeCount=1000, affectRows=1000 2025-09-16 13:55:14.405 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002040, nodeCount=991, validCount=947 2025-09-16 13:55:14.670 INFO 9 --- [ocp-schedules-29,ed49f86c9eaecc20,9ef1742b78283b56] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:55:14.675 INFO 9 --- [ocp-schedules-29,ed49f86c9eaecc20,9ef1742b78283b56] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:55:14.675 INFO 9 --- [ocp-schedules-29,ed49f86c9eaecc20,9ef1742b78283b56] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:55:14.785 INFO 9 --- [ocp-schedules-2,b82acd69a767eb06,9d17cfcef7cca765] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:55:14.794 INFO 9 --- [ocp-async-2,fc4a24e71ae41093,df526ec0493a0077] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:14.794 WARN 9 --- [ocp-async-10,645c1419c03b1c75,70eefac50b9af6e7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:15.530 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:15.531 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:16.636 INFO 9 --- [prometheus-minute-schedule-1,f54d2af1f5a9c12b,90ce963393e9746d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:16.639 INFO 9 --- [prometheus-minute-schedule-1,f54d2af1f5a9c12b,90ce963393e9746d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:16.795 INFO 9 --- [ocp-async-7,6c90d8ae3518b1b0,937dee44e0fb1297] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:16.795 WARN 9 --- [ocp-async-3,6680c5efadceb9e2,846db6fe29ca65e7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:18.531 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:18.532 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:18.795 INFO 9 --- [ocp-async-6,ca89db4a97891784,c8429cf63f9f243e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:18.795 WARN 9 --- [ocp-async-5,c479196a1722f248,1a46f51f7f4b679d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:19.090 INFO 9 --- [ocp-schedules-15,9a9e839778b24ae6,83d5b54ddb78599d] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:55:19.092 INFO 9 --- [ocp-schedules-15,9a9e839778b24ae6,83d5b54ddb78599d] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:55:19.636 INFO 9 --- [prometheus-minute-schedule-1,2360143946a8c7f0,73d151cc2b841978] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:19.639 INFO 9 --- [prometheus-minute-schedule-1,2360143946a8c7f0,73d151cc2b841978] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:55:20.003588+08:00, lastProcessTime=2025-09-16T13:55:10.003478+08:00 2025-09-16 13:55:20.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:55:20.003588+08:00 2025-09-16 13:55:20.184 INFO 9 --- [ocp-async-3,5aea779c58178986,6a4043f7d051278c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:55:20.636 INFO 9 --- [prometheus-cache-monitor1,af5fc9f16f196035,6dd8b79a0a0e5ef3] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:55:20.636 INFO 9 --- [prometheus-cache-monitor1,af5fc9f16f196035,6dd8b79a0a0e5ef3] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:55:20.795 WARN 9 --- [ocp-async-8,5c1c0afbba4e5c7d,c70bdc77b3523095] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:20.795 INFO 9 --- [ocp-async-10,07633a66ae7572b4,023e45c19fb38b09] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:21.295 INFO 9 --- [ocp-schedules-30,8b328b26a45641c8,079f835311e07ce4] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:55:21.301 WARN 9 --- [scanner-1378120-1,8b328b26a45641c8,b9bc9d07a241d714] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:55:21.532 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:21.532 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:22.636 INFO 9 --- [prometheus-minute-schedule-1,94415a3a72846123,21e2312baeca6ffa] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:22.639 INFO 9 --- [prometheus-minute-schedule-1,94415a3a72846123,21e2312baeca6ffa] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:22.795 WARN 9 --- [ocp-async-3,16ff8ed0175d1d65,2930a711b956d7fe] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:22.795 INFO 9 --- [ocp-async-1,3d3a73464aff4d36,a473ec9e78e87e71] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:24.532 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:24.533 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:24.788 INFO 9 --- [ocp-schedules-28,42fffc9cb526fe24,e97386c728109dfe] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:55:24.795 WARN 9 --- [ocp-async-5,1166b53b2093d52e,e985220859d48a05] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:24.795 INFO 9 --- [ocp-async-9,e953c8c72179e4e2,9d9d8f25389e28b9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:25.636 INFO 9 --- [prometheus-minute-schedule-1,d4380252fed13783,b73500e696d8786c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:25.640 INFO 9 --- [prometheus-minute-schedule-1,d4380252fed13783,b73500e696d8786c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:26.795 WARN 9 --- [ocp-async-4,4be69aad3f117f43,fc0544843d6d5fad] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:26.795 INFO 9 --- [ocp-async-8,828d7b75502d7c26,1a29e93ae7591ddc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:27.533 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:27.534 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:28.636 INFO 9 --- [prometheus-minute-schedule-1,e7553842fc452dd5,df17a343ffda53ae] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:28.639 INFO 9 --- [prometheus-minute-schedule-1,e7553842fc452dd5,df17a343ffda53ae] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:28.795 INFO 9 --- [ocp-async-10,4a0554829309229a,3fb7171510f759a3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:28.795 WARN 9 --- [ocp-async-3,0237bf44b3215fcd,21acd95dae34c5dc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:29.095 INFO 9 --- [ocp-schedules-2,88ae789d4262a122,0bad1352c2376713] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:55:29.097 INFO 9 --- [ocp-schedules-2,88ae789d4262a122,0bad1352c2376713] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:55:29.938 INFO 9 --- [ocp-schedules-21,d4ca6dcf8531a167,4ee4af91ae964973] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:55:29.941 INFO 9 --- [ocp-schedules-11,3c29e7292db45a55,3a8b2ff93fa54e31] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:55:29.941 INFO 9 --- [ocp-schedules-10,c855867b724eb304,fc4bd993a6a445cb] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:55:29.942 INFO 9 --- [ocp-schedules-9,5394e0e9674294f7,f22964f527327421] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:55:29.943 INFO 9 --- [ocp-schedules-11,3c29e7292db45a55,3a8b2ff93fa54e31] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:29.943 INFO 9 --- [ocp-schedules-10,c855867b724eb304,fc4bd993a6a445cb] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:29.943 INFO 9 --- [ocp-schedules-9,5394e0e9674294f7,f22964f527327421] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:29.944 INFO 9 --- [ocp-schedules-9,5394e0e9674294f7,f22964f527327421] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:55:29.945 INFO 9 --- [ocp-schedules-14,8bba67250ef935b5,dbbe9b8c355a9c92] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:55:29.945 INFO 9 --- [ocp-schedules-15,2fcbbeee5033a22f,f70ac43774c78275] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:55:29.945 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-agent-status1,2fcbbeee5033a22f,a7f8b4a201397592] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-agent-status2,2fcbbeee5033a22f,1a1e109fb90091b1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-agent-status3,2fcbbeee5033a22f,b406b076911b6c72] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-agent-status4,2fcbbeee5033a22f,875e954e1ae9195a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-agent-status5,2fcbbeee5033a22f,0cf53ad0c96db238] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:55:29.946 INFO 9 --- [host-check-agent-status6,2fcbbeee5033a22f,94366568c5336c9e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:55:29.947 INFO 9 --- [ocp-schedules-13,e9d28d3656249261,658d8ed23f2695b3] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:55:29.947 INFO 9 --- [host-check-clockdiff1,e9d28d3656249261,e2831f6b82612aa8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:55:29.947 INFO 9 --- [host-check-clockdiff2,e9d28d3656249261,96c0f772a3ab804e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:55:29.947 INFO 9 --- [host-check-clockdiff3,e9d28d3656249261,642130e5ad11da3f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:55:29.947 INFO 9 --- [host-check-clockdiff4,e9d28d3656249261,150db37996804bf6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:55:29.947 INFO 9 --- [host-check-clockdiff5,e9d28d3656249261,93bea2d9802147a6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:55:29.947 INFO 9 --- [host-check-clockdiff6,e9d28d3656249261,e4ee72a3e1e7a83f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:55:29.948 INFO 9 --- [ocp-schedules-8,4964ce6df5420f47,4cb6878f4cb2fe80] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:55:29.954 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:55:29.954 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:55:29.954 INFO 9 --- [host-check-agent-status4,2fcbbeee5033a22f,875e954e1ae9195a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:55:29.954 INFO 9 --- [host-check-agent-status2,2fcbbeee5033a22f,1a1e109fb90091b1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:55:29.954 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:55:29.954 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:29.954 INFO 9 --- [host-check-agent-status6,2fcbbeee5033a22f,94366568c5336c9e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:29.954 INFO 9 --- [host-check-agent-status3,2fcbbeee5033a22f,b406b076911b6c72] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:55:29.954 INFO 9 --- [host-check-agent-status5,2fcbbeee5033a22f,0cf53ad0c96db238] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:55:29.954 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:55:29.955 INFO 9 --- [host-check-agent-status1,2fcbbeee5033a22f,a7f8b4a201397592] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:55:29.955 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:55:29.955 INFO 9 --- [host-check-clockdiff5,e9d28d3656249261,93bea2d9802147a6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002129 -1 -1 , error= 2025-09-16 13:55:29.955 INFO 9 --- [host-check-clockdiff1,e9d28d3656249261,e2831f6b82612aa8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002129 -1 -1 , error= 2025-09-16 13:55:29.956 INFO 9 --- [host-check-agent-status2,2fcbbeee5033a22f,1a1e109fb90091b1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:55:29.956 INFO 9 --- [host-check-agent-status5,2fcbbeee5033a22f,0cf53ad0c96db238] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:55:29.956 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:55:29.956 INFO 9 --- [host-check-agent-status1,2fcbbeee5033a22f,a7f8b4a201397592] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:55:29.956 INFO 9 --- [host-check-agent-status6,2fcbbeee5033a22f,94366568c5336c9e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:29.956 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:29.956 INFO 9 --- [host-check-agent-status3,2fcbbeee5033a22f,b406b076911b6c72] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:55:29.956 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:55:29.956 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:55:29.956 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:55:29.956 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:55:29.956 INFO 9 --- [host-check-agent-status4,2fcbbeee5033a22f,875e954e1ae9195a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:55:29.962 INFO 9 --- [ocp-schedules-5,185048f8a66e63d7,dffc7ceb6a029175] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:55:29.963 INFO 9 --- [ocp-schedules-17,792c46ba1405f1b1,cfa499d12f5acb3d] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:55:29.968 INFO 9 --- [ocp-schedules-5,185048f8a66e63d7,dffc7ceb6a029175] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:55:29.970 INFO 9 --- [ocp-schedules-17,792c46ba1405f1b1,cfa499d12f5acb3d] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:55:29.971 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:55:29.971 INFO 9 --- [host-check-agent-status6,2fcbbeee5033a22f,94366568c5336c9e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:55:29.971 INFO 9 --- [host-check-agent-status2,2fcbbeee5033a22f,1a1e109fb90091b1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:55:29.971 INFO 9 --- [host-check-agent-status5,2fcbbeee5033a22f,0cf53ad0c96db238] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:55:29.971 INFO 9 --- [host-check-agent-status1,2fcbbeee5033a22f,a7f8b4a201397592] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:55:29.971 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:29.971 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:55:29.971 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:55:29.972 INFO 9 --- [host-check-agent-status3,2fcbbeee5033a22f,b406b076911b6c72] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:55:29.972 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:55:29.972 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:55:29.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:55:29.973 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:55:29.971546282+08:00 2025-09-16 13:55:29.973 INFO 9 --- [host-check-agent-status4,2fcbbeee5033a22f,875e954e1ae9195a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:55:29.974 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:55:29.973+08:00 2025-09-16 13:55:29.974 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:55:29.972814605+08:00 2025-09-16 13:55:29.974 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:55:29.972780326+08:00 2025-09-16 13:55:29.974 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:55:29.973274040+08:00 2025-09-16 13:55:29.974 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:55:29.974+08:00 2025-09-16 13:55:29.974 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:55:29.974+08:00 2025-09-16 13:55:29.974 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:55:29.974+08:00 2025-09-16 13:55:29.975 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:55:29.973474305+08:00 2025-09-16 13:55:29.975 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:55:29.975 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:55:29.975+08:00 2025-09-16 13:55:29.975 INFO 9 --- [host-check-agent-status6,2fcbbeee5033a22f,94366568c5336c9e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:55:29.975 INFO 9 --- [host-check-agent-status6,2fcbbeee5033a22f,94366568c5336c9e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:55:29.975 INFO 9 --- [host-check-agent-status6,2fcbbeee5033a22f,94366568c5336c9e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:55:29.975 INFO 9 --- [host-check-agent-status2,2fcbbeee5033a22f,1a1e109fb90091b1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:55:29.975 INFO 9 --- [host-check-agent-status2,2fcbbeee5033a22f,1a1e109fb90091b1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:55:29.975 INFO 9 --- [host-check-agent-status2,2fcbbeee5033a22f,1a1e109fb90091b1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:55:29.975 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:55:29.973+08:00 and status AVAILABLE 2025-09-16 13:55:29.976 INFO 9 --- [host-check-agent-status1,2fcbbeee5033a22f,a7f8b4a201397592] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:55:29.976 INFO 9 --- [host-check-agent-status1,2fcbbeee5033a22f,a7f8b4a201397592] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:55:29.976 INFO 9 --- [host-check-agent-status1,2fcbbeee5033a22f,a7f8b4a201397592] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:55:29.976 INFO 9 --- [host-check-agent-status5,2fcbbeee5033a22f,0cf53ad0c96db238] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:55:29.976 INFO 9 --- [host-check-agent-status5,2fcbbeee5033a22f,0cf53ad0c96db238] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:55:29.976 INFO 9 --- [host-check-agent-status5,2fcbbeee5033a22f,0cf53ad0c96db238] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:55:29.976 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:55:29.974+08:00 and status AVAILABLE 2025-09-16 13:55:29.976 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:55:29.974+08:00 and status AVAILABLE 2025-09-16 13:55:29.976 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:55:29.974+08:00 and status AVAILABLE 2025-09-16 13:55:29.976 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:55:29.975821490+08:00 2025-09-16 13:55:29.977 INFO 9 --- [host-check-agent-status3,2fcbbeee5033a22f,b406b076911b6c72] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:55:29.977 INFO 9 --- [host-check-agent-status3,2fcbbeee5033a22f,b406b076911b6c72] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:55:29.977 INFO 9 --- [host-check-agent-status3,2fcbbeee5033a22f,b406b076911b6c72] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:55:29.977 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:55:29.975+08:00 and status AVAILABLE 2025-09-16 13:55:29.977 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:55:29.977+08:00 2025-09-16 13:55:29.977 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:55:29.977 INFO 9 --- [ocp-schedules-10,c855867b724eb304,fc4bd993a6a445cb] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:55:29.978 INFO 9 --- [host-check-agent-status4,2fcbbeee5033a22f,875e954e1ae9195a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:55:29.978 INFO 9 --- [host-check-agent-status4,2fcbbeee5033a22f,875e954e1ae9195a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:55:29.978 INFO 9 --- [host-check-agent-status4,2fcbbeee5033a22f,875e954e1ae9195a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:55:29.978 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:55:29.978 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:55:29.977+08:00 and status AVAILABLE 2025-09-16 13:55:29.980 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:55:29.980 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:55:29.980 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:55:29.980 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:55:29.980 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:55:29.985 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:55:29.986 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:55:29.986 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:29.986 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:55:29.986 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:55:29.986 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:55:29.987 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:55:29.987 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:29.987 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:55:29.987 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:55:29.987 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:55:29.988 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:55:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:55:30.000 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:30.000 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:30.000 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:30.001 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:30.001 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:30.002 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:55:30.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:55:30.002574+08:00, lastProcessTime=2025-09-16T13:55:20.003588+08:00 2025-09-16 13:55:30.026 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:30.027 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:55:30.027 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:55:30.027 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:30.028 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:55:30.029 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:55:30.029 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:55:30.030 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:55:30.034 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:55:30.034 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:55:30.035 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:55:30.035 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:55:30.036 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:55:30.036 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:55:30.041 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:55:30.046 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:30.047 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:30.047 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:30.048 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:30.048 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:30.053 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:55:30.065 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:30.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:30.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:55:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:30.074 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:55:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:55:30.075 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:55:30.075 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:55:30.076 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:55:30.076 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:30.077 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:55:30.080 INFO 9 --- [ocp-schedules-22,fb6b305f738abf4b,7d565e31e94124e0] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:55:30.081 INFO 9 --- [ocp-schedules-22,fb6b305f738abf4b,7d565e31e94124e0] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:55:30.081 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:55:30.082 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:55:30.082 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:55:30.082 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:55:30.083 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:55:30.084 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:55:30.087 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:55:30.092 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.092 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:30.094 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:30.095 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:30.095 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:30.096 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:30.096 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:30.098 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:55:30.101 INFO 9 --- [prometheus-second-schedule-1,4631026e3cb46d3a,379d6665c4d502b5] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:55:30.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:30.121 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:55:30.122 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:55:30.123 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:55:30.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:30.124 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:55:30.125 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:55:30.127 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:55:30.128 INFO 9 --- [host-check-host-status2,8bba67250ef935b5,c955fb43fa21882b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:55:30.130 INFO 9 --- [host-check-host-status4,8bba67250ef935b5,57f2c7020aa0ac1f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:55:30.130 INFO 9 --- [host-check-host-status3,8bba67250ef935b5,1c98338f5fa9622a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:55:30.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:55:30.002574+08:00 2025-09-16 13:55:30.132 INFO 9 --- [host-check-host-status6,8bba67250ef935b5,20909050c640c2d0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:55:30.132 INFO 9 --- [host-check-host-status5,8bba67250ef935b5,90340f9c42e09eca] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:55:30.134 INFO 9 --- [host-check-host-status1,8bba67250ef935b5,2cbd54e2601a670c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:55:30.141 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.141 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:30.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:30.170 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:30.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:30.184 INFO 9 --- [ocp-async-8,a86e4bcdc9278d39,dc8b3e8e09eb6b70] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:55:30.200 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.200 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:55:30.212 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.212 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:55:30.227 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:55:30.241 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:30.242 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:30.243 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:55:30.248 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:55:30.251 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:55:30.254 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:30.255 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:30.268 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:55:30.274 INFO 9 --- [ocp-schedules-3,66c85a0eeb3a0835,a1fe02268b95af11] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:55:30.275 INFO 9 --- [ocp-schedules-3,66c85a0eeb3a0835,a1fe02268b95af11] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:30.275 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:55:30.276 INFO 9 --- [ocp-schedules-3,66c85a0eeb3a0835,a1fe02268b95af11] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:55:30.335 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:55:30.350 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:30.351 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:30.352 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:55:30.366 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:55:30.366 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:55:30.366 INFO 9 --- [ocp-schedules-11,3c29e7292db45a55,3a8b2ff93fa54e31] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:55:30.403 INFO 9 --- [ocp-schedules-1,08c594f1ebc785c6,0261b7b8f51ae439] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:55:30.534 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:30.534 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:30.590 INFO 9 --- [ocp-schedules-8,cf026ac994de2e0e,d555a944631ff1f5] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:55:30.593 INFO 9 --- [ocp-schedules-8,cf026ac994de2e0e,d555a944631ff1f5] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:55:30.593 INFO 9 --- [ocp-schedules-8,cf026ac994de2e0e,d555a944631ff1f5] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:55:30.795 INFO 9 --- [ocp-async-6,0c6c18b7f380adfc,c4ec9beadf4d1bb2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:30.795 WARN 9 --- [ocp-async-4,7530c119434b300d,7f5bb64229252b4c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:30.850 INFO 9 --- [ocp-schedules-22,aa4a4c26f99b9fc1,c582485768954f38] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:55:30.890 INFO 9 --- [host-check-clockdiff6,e9d28d3656249261,e4ee72a3e1e7a83f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002130 -1 -1 , error= 2025-09-16 13:55:30.890 INFO 9 --- [host-check-clockdiff2,e9d28d3656249261,96c0f772a3ab804e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002130 -2 -2 , error= 2025-09-16 13:55:30.890 INFO 9 --- [host-check-clockdiff3,e9d28d3656249261,642130e5ad11da3f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002130 -2 -2 , error= 2025-09-16 13:55:30.980 INFO 9 --- [ocp-schedules-25,71d5f9f8349baf38,d0cb79654e887a97] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:55:30.980 INFO 9 --- [ocp-schedules-25,71d5f9f8349baf38,d0cb79654e887a97] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:55:31.324 INFO 9 --- [ocp-schedules-23,4eb3fc2ae44933bc,41e99d7308678666] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:55:31.328 WARN 9 --- [scanner-1378280-1,4eb3fc2ae44933bc,0eb806b12b9b4596] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:55:31.480 INFO 9 --- [ocp-schedules-16,9c7e7816fa5c49aa,a21eb45a5f5cd3a2] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:55:31.480 INFO 9 --- [ocp-schedules-16,9c7e7816fa5c49aa,a21eb45a5f5cd3a2] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002131 2025-09-16 13:55:31.480 INFO 9 --- [ocp-schedules-16,9c7e7816fa5c49aa,a21eb45a5f5cd3a2] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:55:31.636 INFO 9 --- [prometheus-minute-schedule-1,12861334b19dadfd,23e2e3d03a009eb1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:31.639 INFO 9 --- [prometheus-minute-schedule-1,12861334b19dadfd,23e2e3d03a009eb1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:31.648 INFO 9 --- [ocp-schedules-3,c3c9e2043b17e591,98f52652c9440c7e] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:55:31.699 INFO 9 --- [ocp-schedules-11,86c07ef66bfd9845,4e036dd3c71ce207] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:55:31.699 INFO 9 --- [ocp-schedules-11,86c07ef66bfd9845,4e036dd3c71ce207] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 13:55:31.700 INFO 9 --- [ocp-schedules-11,86c07ef66bfd9845,4e036dd3c71ce207] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:55:31.700 INFO 9 --- [ocp-schedules-11,86c07ef66bfd9845,4e036dd3c71ce207] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:55:31.700 INFO 9 --- [ocp-schedules-11,86c07ef66bfd9845,4e036dd3c71ce207] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:55:31.700 INFO 9 --- [ocp-schedules-11,86c07ef66bfd9845,4e036dd3c71ce207] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:55:31.704 INFO 9 --- [ocp-schedules-1,db4e067ebd674284,a753d2aca12f5f90] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:55:31.731 INFO 9 --- [host-check-clockdiff4,e9d28d3656249261,150db37996804bf6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002131 -1 -1 , error= 2025-09-16 13:55:31.782 INFO 9 --- [ocp-schedules-21,0b49520dda7bc3ba,a492cbaee166fa3b] c.o.o.s.common.scheduled.PerfSchedules : Collect high risk sql audit stat, time=2025-09-16T13:55:31.782+08:00, tenantSize=3 2025-09-16 13:55:31.785 INFO 9 --- [ocp-schedules-21,0b49520dda7bc3ba,a492cbaee166fa3b] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2currentTimeUs:1758002131782000 2025-09-16 13:55:31.785 INFO 9 --- [ocp-schedules-21,0b49520dda7bc3ba,a492cbaee166fa3b] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2diagnosisStartTimeUs:1758001831759000 2025-09-16 13:55:31.800 INFO 9 --- [ocp-schedules-21,0b49520dda7bc3ba,a492cbaee166fa3b] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2totalLength:0 2025-09-16 13:55:31.806 INFO 9 --- [ocp-schedules-21,0b49520dda7bc3ba,a492cbaee166fa3b] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3currentTimeUs:1758002131802000 2025-09-16 13:55:31.806 INFO 9 --- [ocp-schedules-21,0b49520dda7bc3ba,a492cbaee166fa3b] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3diagnosisStartTimeUs:1758001831738000 2025-09-16 13:55:31.821 INFO 9 --- [ocp-schedules-21,0b49520dda7bc3ba,a492cbaee166fa3b] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3totalLength:0 2025-09-16 13:55:32.796 INFO 9 --- [ocp-async-8,309a1d8ea105bb45,249b381776d6ff27] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:32.796 WARN 9 --- [ocp-async-7,3edaec4ed3796d7f,5d95a63363d4ffe9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:33.439 INFO 9 --- [ocp-schedules-3,078fc7e849d26112,0979ab2cb332a2cd] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:55:33.534 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:33.535 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:33.571 INFO 9 --- [ocp-schedules-28,823c02719b768359,9ac540687c7be44c] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:55:33.571+08:00, clusters=[1] 2025-09-16 13:55:33.573 INFO 9 --- [ocp-schedules-28,823c02719b768359,9ac540687c7be44c] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:55:34.137 INFO 9 --- [ocp-schedules-19,26282121268cd784,eabbfbb1a1efc3e1] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:55:34.137 INFO 9 --- [ocp-schedules-19,26282121268cd784,eabbfbb1a1efc3e1] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:55:34.137 INFO 9 --- [ocp-schedules-19,26282121268cd784,eabbfbb1a1efc3e1] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:55:34.152 INFO 9 --- [ocp-schedules-19,26282121268cd784,eabbfbb1a1efc3e1] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:55:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:55:34.636 INFO 9 --- [prometheus-minute-schedule-1,acebdd3b6ea70ee6,a2c908008079bc6b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:34.639 INFO 9 --- [prometheus-minute-schedule-1,acebdd3b6ea70ee6,a2c908008079bc6b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:34.677 INFO 9 --- [ocp-schedules-21,dd1c7128312efbb6,14b36b9c14522ea9] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:55:34.681 INFO 9 --- [ocp-schedules-21,dd1c7128312efbb6,14b36b9c14522ea9] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:55:34.682 INFO 9 --- [ocp-schedules-21,dd1c7128312efbb6,14b36b9c14522ea9] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:55:34.791 INFO 9 --- [ocp-schedules-18,0fc01d17d3cf3abb,1aad8b82a6c97f57] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:55:34.796 INFO 9 --- [ocp-async-10,2d74a652dd95c2a4,fbc4c5d7ebdca04e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:34.796 WARN 9 --- [ocp-async-5,8abb88e035731d41,3431a40ecf48843a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:35.622 INFO 9 --- [ocp-schedules-19,ce6016967d2c117f,9b1e877fafab054a] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:55:35.622+08:00, clusters=[1] 2025-09-16 13:55:35.670 INFO 9 --- [ocp-schedules-19,ce6016967d2c117f,9b1e877fafab054a] c.o.o.p.s.i.alarm.SlowSqlDataSource : collect SlowSqlData for zhengqi, save 1 to SqlAggregateData 2025-09-16 13:55:36.535 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:36.536 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:36.796 INFO 9 --- [ocp-async-9,da35b170388e7250,c3f0437bc76dd0cc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:36.796 WARN 9 --- [ocp-async-2,13a01c2fb99480b6,4914e218c2759a00] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:37.636 INFO 9 --- [prometheus-minute-schedule-1,368e41f3af689cdf,702182c6b63ad3b7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:37.639 INFO 9 --- [prometheus-minute-schedule-1,368e41f3af689cdf,702182c6b63ad3b7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:37.840 INFO 9 --- [ocp-schedules-21,8cbc8fe1493bc34a,1ad0dec12f05155d] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:55:37.841 INFO 9 --- [ocp-schedules-21,8cbc8fe1493bc34a,1ad0dec12f05155d] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:37.860 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:37.861 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:55:37.874 INFO 9 --- [ocp-schedules-21,8cbc8fe1493bc34a,1ad0dec12f05155d] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:55:38.796 INFO 9 --- [ocp-async-6,45960dd61059eaee,375728653337b43f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:38.796 WARN 9 --- [ocp-async-3,4058350d1cf37b8c,346f54c8a14e9e0c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:39.102 INFO 9 --- [ocp-schedules-13,4a92a83280a5bf56,e38f68331a723cd8] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:55:39.104 INFO 9 --- [ocp-schedules-13,4a92a83280a5bf56,e38f68331a723cd8] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:55:39.536 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:39.537 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:39.909 INFO 9 --- [ocp-schedules-14,20ab747fde935371,9dbeda341481356b] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:55:39.909 INFO 9 --- [ocp-schedules-14,20ab747fde935371,9dbeda341481356b] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:55:39.922 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:55:39.922 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:55:39.922 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:55:39.922 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:55:39.922 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:55:39.922 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:55:39.924 INFO 9 --- [Collect all tenants major compactions1,20ab747fde935371,22dbfa2002ca6618] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:55:39.924 INFO 9 --- [Collect all tenants major compactions3,20ab747fde935371,32dfa565690113b3] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:55:39.924 INFO 9 --- [Collect all tenants major compactions2,20ab747fde935371,dc12d14a5ebb3710] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:55:39.925 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:55:39.925 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:55:39.925 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:55:39.926 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:55:39.926 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:39.926 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:55:39.926 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:55:39.926 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:55:39.927 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:55:39.927 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:39.941 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:55:39.941 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:55:39.941 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:55:39.941 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:55:39.942 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:55:39.942 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:55:39.942 INFO 9 --- [Collect all tenants major compactions1,20ab747fde935371,22dbfa2002ca6618] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:39.943 INFO 9 --- [Collect all tenants major compactions3,20ab747fde935371,32dfa565690113b3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:39.943 INFO 9 --- [Collect all tenants major compactions2,20ab747fde935371,dc12d14a5ebb3710] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:39.944 INFO 9 --- [Collect all tenants major compactions2,20ab747fde935371,dc12d14a5ebb3710] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:55:39.944 INFO 9 --- [Collect all tenants major compactions1,20ab747fde935371,22dbfa2002ca6618] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:55:39.944 INFO 9 --- [Collect all tenants major compactions3,20ab747fde935371,32dfa565690113b3] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:55:39.945 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:55:39.946 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:55:39.948 INFO 9 --- [Collect all tenants major compactions3,20ab747fde935371,32dfa565690113b3] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:55:39.949 INFO 9 --- [Collect all tenants major compactions1,20ab747fde935371,22dbfa2002ca6618] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:55:39.949 INFO 9 --- [Collect all tenants major compactions2,20ab747fde935371,dc12d14a5ebb3710] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:55:39.949 INFO 9 --- [ocp-schedules-14,20ab747fde935371,9dbeda341481356b] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:55:39.959 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:55:39.960 INFO 9 --- [ocp-schedules-3,e72849f96bdb60c0,bfeb18e2d13bc7fa] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:55:40.001 INFO 9 --- [ocp-schedules-12,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:55:40.002 INFO 9 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:55:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:55:40.003174+08:00, lastProcessTime=2025-09-16T13:55:30.002574+08:00 2025-09-16 13:55:40.125 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:55:40.003174+08:00 2025-09-16 13:55:40.184 INFO 9 --- [ocp-async-4,63e6178052652c64,826c15edc61e1572] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:55:40.636 INFO 9 --- [prometheus-minute-schedule-1,ff02c2807642a611,5588637229daca73] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:40.639 INFO 9 --- [prometheus-minute-schedule-1,ff02c2807642a611,5588637229daca73] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:40.796 INFO 9 --- [ocp-async-1,b7696b22861cc94f,41fd43e189083fa9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:40.796 WARN 9 --- [ocp-async-2,6bbb4a5e30355277,7e68d421a1c1381d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:41.003 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:51:40.958, end=2025-09-16T13:53:41} 2025-09-16 13:55:41.005 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbit 2025-09-16 13:55:41.006 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:55:41.008 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:51:40.958, end=2025-09-16T13:53:41},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:55:41.008 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:55:41.008 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:55:41.069 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915741069000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:55:41.069Z, endTime=2025-09-16T05:53:41Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNN 2025-09-16 13:55:41.071 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915741070000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=E6169347D3BE010412F196B5636A010E, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:55:41.070Z, endTime=2025-09-16T05:53:41Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNN 2025-09-16 13:55:41.074 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915741074000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=059C3EF76E9644CCC465E3910B3A28F8, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:55:41.074Z, endTime=2025-09-16T05:53:41Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNN 2025-09-16 13:55:41.077 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 36 2025-09-16 13:55:41.077 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:55:41.079 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 36 2025-09-16 13:55:41.079 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:55:41.082 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 38 2025-09-16 13:55:41.082 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:55:41.092 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:55:41.092 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 13:55:41.093 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:55:41.093 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=E6169347D3BE010412F196B5636A010E, sqlIdList=null, dynamicSql=false) 2025-09-16 13:55:41.096 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:55:41.096 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=059C3EF76E9644CCC465E3910B3A28F8, sqlIdList=null, dynamicSql=false) 2025-09-16 13:55:41.099 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:55:41.099 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:55:41.100 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:55:41.100 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:55:41.103 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:55:41.103 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:55:41.113 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:55:41.113 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 13:55:41.115 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:55:41.115 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=E6169347D3BE010412F196B5636A010E, sqlIdList=null, dynamicSql=false) 2025-09-16 13:55:41.120 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 13:55:41.121 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 13:55:41.121 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:55:41.121 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002021000000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=059C3EF76E9644CCC465E3910B3A28F8, sqlIdList=null, dynamicSql=false) 2025-09-16 13:55:41.128 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 13:55:41.143 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:55:41.069, end=2025-09-16T13:53:41}, clusterId=1, tenantId=3, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:55:41.146 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:55:41.07, end=2025-09-16T13:53:41}, clusterId=1, tenantId=3, sqlId=E6169347D3BE010412F196B5636A010E, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:55:41.152 INFO 9 --- [plan_change_detector8,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:55:41.074, end=2025-09-16T13:53:41}, clusterId=1, tenantId=3, sqlId=059C3EF76E9644CCC465E3910B3A28F8, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:55:41.152 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:55:41.157 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 2 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:51:40.958, end=2025-09-16T13:53:41},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:55:41.164 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:55:41.164 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:55:41.174 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:55:41.176 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:51:40.958, end=2025-09-16T13:53:41},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:55:41.176 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:55:41.176 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:55:41.180 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:55:41.350 INFO 9 --- [ocp-schedules-3,6c81460aab512f43,03e7bdfa1bda1708] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:55:41.355 WARN 9 --- [scanner-1378401-1,6c81460aab512f43,6f577c991a8ea92c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:55:41.365 INFO 9 --- [alarm-detect-5,6c81460aab512f43,b7156fa9a662541e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 35, data is empty. 2025-09-16 13:55:41.367 INFO 9 --- [alarm-detect-8,6c81460aab512f43,653076b43b384b42] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 35, data is empty. 2025-09-16 13:55:41.367 INFO 9 --- [alarm-detect-10,6c81460aab512f43,5d5b0b02fb6e7b14] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 35, data is empty. 2025-09-16 13:55:41.380 INFO 9 --- [alarm-detect-2,6c81460aab512f43,d198d291adc9bfa9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 35, data is empty. 2025-09-16 13:55:42.394 INFO 9 --- [ocp-schedules-19,4d9c88acc99109b5,54f4c260b19d82a4] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:55:42.394 INFO 9 --- [ocp-schedules-19,4d9c88acc99109b5,54f4c260b19d82a4] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:55:42.430 INFO 9 --- [ocp-schedules-19,4d9c88acc99109b5,54f4c260b19d82a4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:42.431 INFO 9 --- [ocp-schedules-19,4d9c88acc99109b5,54f4c260b19d82a4] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:55:42.537 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:42.538 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:42.796 INFO 9 --- [ocp-async-4,7345f6ad503a23b7,5e167f91e77b7d96] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:42.796 WARN 9 --- [ocp-async-3,7f0db490a74e6723,4e55e711fbddb6a0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:43.636 INFO 9 --- [prometheus-minute-schedule-1,2932619cd0521659,83aa1bdbca980e49] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:43.639 INFO 9 --- [prometheus-minute-schedule-1,2932619cd0521659,83aa1bdbca980e49] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:44.794 INFO 9 --- [ocp-schedules-24,dbf111fb16208899,79608a6a1b58a01b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:55:44.796 WARN 9 --- [ocp-async-8,3f196f24c897285b,f545de958e1bb4a7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:44.796 INFO 9 --- [ocp-async-6,f2f0142c9cca4741,0a761c6e39e585f5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:45.052 INFO 9 --- [ocp-schedules-12,f0a39386957199a8,4f964a1663381a44] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:55:45.053 INFO 9 --- [ocp-schedules-12,f0a39386957199a8,4f964a1663381a44] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:45.096 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:55:45.096 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.099 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:55:45.128 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.128 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:55:45.151 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.152 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:55:45.175 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.175 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:55:45.180 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.180 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:55:45.203 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.204 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:55:45.227 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.228 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:55:45.233 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.233 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:55:45.257 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.258 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:55:45.279 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.280 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:55:45.298 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.299 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:55:45.300 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.301 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:55:45.301 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.302 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:55:45.303 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.303 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:55:45.304 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.304 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:55:45.305 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.306 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:55:45.321 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.322 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:55:45.323 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.323 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:55:45.324 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.325 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:55:45.339 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:55:45.340 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:55:45.367 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:55:45.369 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:45.369 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:55:45.398 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:55:45.398 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:55:45.398 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:55:45.398 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:55:45.398 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:55:45.398 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:55:45.400 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:55:45.400 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:55:45.400 INFO 9 --- [ocp-schedules-12,f0a39386957199a8,4f964a1663381a44] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:55:45.538 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:45.538 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 13:55:45,970 |-INFO in ReconfigureOnChangeTask(born:1758001965970) - Empty watch file list. Disabling 2025-09-16 13:55:46.325 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 13:55:46.325 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 13:55:46.327 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:55:46.327 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:55:46.327 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:55:46.327 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:55:46.330 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:55:46.330 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:55:46.330 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:55:46.330 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:55:46.348 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:55:46.352 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:55:46.352 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:55:46.352 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:55:46.352 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:55:46.352 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:55:46.357 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:55:46.616 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 13:55:46.636 INFO 9 --- [prometheus-minute-schedule-1,6fd1a8ad4742a8f4,9e5958f58b7b4885] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:46.639 INFO 9 --- [prometheus-minute-schedule-1,6fd1a8ad4742a8f4,9e5958f58b7b4885] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:46.796 INFO 9 --- [ocp-async-5,30697b4dc48c5254,beb28da2caf20bea] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:46.796 WARN 9 --- [ocp-async-10,767be22453d92001,e086fe20f350de44] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:46.891 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.56077743S 2025-09-16 13:55:46.891 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:55:46.943 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 13:55:46.943 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 13:55:46.973 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 13:55:46,985 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:55:46,986 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:55:46,986 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:55:46,987 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:55:46,987 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:55:46,987 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:55:46,985 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:55:46,986 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:55:46,986 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:55:46,987 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:55:46,987 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:55:46,987 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:55:46,987 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@462b6c98 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 13:55:46,990 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 13:55:46,990 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 13:55:46,991 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 13:55:46,991 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@462b6c98 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 13:55:46,992 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 13:55:46,992 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 13:55:46,992 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 13:55:46,992 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 13:55:46,992 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 13:55:46,993 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:55:46,993 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 13:55:46,993 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:55:46,993 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:55:46,993 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:55:46,993 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 13:55:46,993 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 13:55:46,993 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 13:55:46,994 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 13:55:46,994 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:55:46,994 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 13:55:46,994 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1547505277 - setting totalSizeCap to 10 GB 13:55:46,994 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1547505277 - Archive files will be limited to [100 MB] each. 13:55:46,994 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1547505277 - Will use gz compression 13:55:46,994 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1547505277 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 13:55:46,994 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@41efe6ce - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 13:55:46,994 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@41efe6ce - Roll-over at midnight. 13:55:46,994 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@41efe6ce - Setting initial period to Tue Sep 16 13:55:46 CST 2025 13:55:46,994 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1547505277 - Cleaning on start up 13:55:46,994 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 13:55:46,994 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 13:55:46,995 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 13:55:46,995 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 13:55:46,995 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 13:55:46,995 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 13:55:46,995 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@705350899 - setting totalSizeCap to 10 GB 13:55:46,995 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@705350899 - Archive files will be limited to [100 MB] each. 13:55:46,995 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@705350899 - Will use gz compression 13:55:46,995 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@705350899 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 13:55:46,995 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1ef07129 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 13:55:46,995 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1ef07129 - Roll-over at midnight. 13:55:46,995 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1ef07129 - Setting initial period to Tue Sep 16 13:55:12 CST 2025 13:55:46,995 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 13:55:46,995 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 13:55:46,995 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 13:55:46,995 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 13:55:46,995 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 13:55:46,995 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 13:55:46,995 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 13:55:46,995 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 13:55:46,996 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 13:55:46,996 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 13:55:46,996 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating INFO level on Logger[ROOT] onto the JUL framework 13:55:46,996 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 13:55:46,996 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 13:55:46,996 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 13:55:46,996 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:55:46,996 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@20973daf - Registering current configuration as safe fallback point 13:55:46,997 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 13:55:47,000 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating INFO level on Logger[web] onto the JUL framework 13:55:47,000 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 13:55:47,000 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@5d225305 - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 13:55:47.001 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:55:47.001 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:55:47.001 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:55:47.001 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:55:47.001 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:55:47.001 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 13:55:47.007 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:55:47.098 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] o.s.boot.SpringApplication : Started application in 0.77 seconds (JVM running for 13122.142) 2025-09-16 13:55:47.098 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.770834229S 2025-09-16 13:55:47.362 INFO 9 --- [ocp-schedules-3,0c532437282d6876,c1623c740d255575] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 13:55:48.539 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:48.539 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:48.797 INFO 9 --- [ocp-async-3,f3586e26ba54e7fe,2b89f196d8adcc2e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:48.797 WARN 9 --- [ocp-async-9,24a2238367754240,c39d76a3fdcc3cc5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:49.109 INFO 9 --- [ocp-schedules-1,974732e6c8f123e2,9f414d8701c8106c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:55:49.111 INFO 9 --- [ocp-schedules-1,974732e6c8f123e2,9f414d8701c8106c] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:55:49.636 INFO 9 --- [prometheus-minute-schedule-1,5f6c2103c09a1a27,c3699cfe92a1511a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:49.639 INFO 9 --- [prometheus-minute-schedule-1,5f6c2103c09a1a27,c3699cfe92a1511a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:55:50.004+08:00, lastProcessTime=2025-09-16T13:55:40.003174+08:00 2025-09-16 13:55:50.113 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:55:50.004+08:00 2025-09-16 13:55:50.185 INFO 9 --- [ocp-async-10,62a7ad99a1d3caa8,453f8e2d3c622e34] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:55:50.797 WARN 9 --- [ocp-async-7,ba6c1d00d7ac17e3,0a884ad1cee4656c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:50.797 INFO 9 --- [ocp-async-6,e86548a791d59cf7,1d2c73fb9b583c95] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:51.382 INFO 9 --- [ocp-schedules-26,6c0579f0af64c668,3478a2c431dbef2b] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:55:51.387 WARN 9 --- [scanner-1378567-1,6c0579f0af64c668,e0807602dd137157] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:55:51.540 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:51.540 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:52.636 INFO 9 --- [prometheus-minute-schedule-1,eddcc47bac9ea6c5,6d8a4662bec1d0a7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:52.639 INFO 9 --- [prometheus-minute-schedule-1,eddcc47bac9ea6c5,6d8a4662bec1d0a7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:52.797 WARN 9 --- [ocp-async-2,c946ace500cfc736,44c6512c6bd750e3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:52.797 INFO 9 --- [ocp-async-5,20160ec573d44e18,a447b6cef50d463c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:54.540 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:54.541 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:54.683 INFO 9 --- [ocp-schedules-22,a4b902162825de15,b5c8dc8429e7dd46] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:55:54.688 INFO 9 --- [ocp-schedules-22,a4b902162825de15,b5c8dc8429e7dd46] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:55:54.688 INFO 9 --- [ocp-schedules-22,a4b902162825de15,b5c8dc8429e7dd46] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:55:54.797 WARN 9 --- [ocp-async-1,b308ab1842450cd2,8ba8b1000069bbf7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:54.797 INFO 9 --- [ocp-async-3,1fbbecbeb3f98453,29e199ca4a39d338] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:54.798 INFO 9 --- [ocp-schedules-6,1a5a5d3602528e0c,a8bec4b71f8862cb] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:55:55.636 INFO 9 --- [prometheus-minute-schedule-1,771a822a5f0a5cd3,f13c8a473442ef97] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:55.640 INFO 9 --- [prometheus-minute-schedule-1,771a822a5f0a5cd3,f13c8a473442ef97] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:56.797 WARN 9 --- [ocp-async-7,14f543ab8e48ce22,afaf3b4bd58d48e1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:56.797 INFO 9 --- [ocp-async-8,e8578318bf521839,c9158665386c8822] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:57.541 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:55:57.541 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:55:58.636 INFO 9 --- [prometheus-minute-schedule-1,2f9aa1d04553e4e5,5d0b17d632f7567f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002160, interval=60 2025-09-16 13:55:58.639 INFO 9 --- [prometheus-minute-schedule-1,2f9aa1d04553e4e5,5d0b17d632f7567f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:55:58.797 WARN 9 --- [ocp-async-2,76dfbc05f3d8d13f,432e667f2bad1dfa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:55:58.797 INFO 9 --- [ocp-async-10,998fe6f087aef2ef,e0e79b9e322ee55a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:55:59.115 INFO 9 --- [ocp-schedules-4,5719db7d474d6f3c,3363ac059df366ef] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:55:59.117 INFO 9 --- [ocp-schedules-4,5719db7d474d6f3c,3363ac059df366ef] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:55:59.773 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,b2350b89ad795411,3f3f4c8727179fee] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=b2350b89ad795411, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:55:59.773 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,b2350b89ad795411,3f3f4c8727179fee] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=b2350b89ad795411, duration=1 ms] 2025-09-16 13:55:59.938 INFO 9 --- [ocp-schedules-27,8e47a0c0a16b60d0,32ca2616d524c99a] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:55:59.941 INFO 9 --- [ocp-schedules-20,90ee5cb49d5a5982,f80963069438f05a] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:55:59.941 INFO 9 --- [ocp-schedules-28,ed21218df04215ea,99921be0b3b71ab5] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:55:59.942 INFO 9 --- [ocp-schedules-9,f34080f054928f28,27198adc74ba83fb] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:55:59.943 INFO 9 --- [ocp-schedules-9,f34080f054928f28,27198adc74ba83fb] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:59.944 INFO 9 --- [ocp-schedules-9,f34080f054928f28,27198adc74ba83fb] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:55:59.944 INFO 9 --- [ocp-schedules-28,ed21218df04215ea,99921be0b3b71ab5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:59.944 INFO 9 --- [ocp-schedules-20,90ee5cb49d5a5982,f80963069438f05a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:55:59.944 INFO 9 --- [ocp-schedules-25,edb230e8bfac6e85,599cb9cf664d44e6] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:55:59.945 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:55:59.945 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:55:59.945 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:55:59.945 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:55:59.945 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:55:59.945 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:55:59.945 INFO 9 --- [ocp-schedules-18,7f2e90c78787e280,7e522ca0505051dc] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:55:59.945 INFO 9 --- [host-check-agent-status1,7f2e90c78787e280,02dfd85e3720f840] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:55:59.945 INFO 9 --- [host-check-agent-status2,7f2e90c78787e280,31371a87e35532e8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:55:59.946 INFO 9 --- [host-check-agent-status3,7f2e90c78787e280,dddda17c5cb2e7fe] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:55:59.946 INFO 9 --- [host-check-agent-status4,7f2e90c78787e280,84dc9a3da353994c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:55:59.946 INFO 9 --- [host-check-agent-status5,7f2e90c78787e280,9dada0ba3a302e72] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:55:59.946 INFO 9 --- [host-check-agent-status6,7f2e90c78787e280,6bab4932e825a787] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:55:59.947 INFO 9 --- [ocp-schedules-17,0bd89432d60f5070,c264c10eb38aa2ab] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:55:59.947 INFO 9 --- [host-check-clockdiff1,0bd89432d60f5070,1298421dcf424bfd] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:55:59.947 INFO 9 --- [host-check-clockdiff2,0bd89432d60f5070,305ac764bba59d8d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:55:59.947 INFO 9 --- [host-check-clockdiff3,0bd89432d60f5070,491aa8cbb0b6924f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:55:59.947 INFO 9 --- [ocp-schedules-22,d3e28f075db36714,9003d63dc847348a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:55:59.947 INFO 9 --- [host-check-clockdiff4,0bd89432d60f5070,3464780351dd8da6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:55:59.948 INFO 9 --- [host-check-clockdiff6,0bd89432d60f5070,9171f1faf06d83ee] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:55:59.948 INFO 9 --- [host-check-clockdiff5,0bd89432d60f5070,646f32ea45fae784] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:55:59.948 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:55:59.948 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:55:59.948 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:55:59.949 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:59.949 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:55:59.949 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:55:59.949 INFO 9 --- [host-check-agent-status3,7f2e90c78787e280,dddda17c5cb2e7fe] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:55:59.949 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:55:59.949 INFO 9 --- [host-check-agent-status6,7f2e90c78787e280,6bab4932e825a787] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:59.949 INFO 9 --- [host-check-agent-status1,7f2e90c78787e280,02dfd85e3720f840] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:55:59.949 INFO 9 --- [host-check-agent-status2,7f2e90c78787e280,31371a87e35532e8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:55:59.949 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:55:59.949 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:55:59.954 INFO 9 --- [host-check-agent-status5,7f2e90c78787e280,9dada0ba3a302e72] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:55:59.954 INFO 9 --- [host-check-agent-status4,7f2e90c78787e280,84dc9a3da353994c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:55:59.954 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:55:59.954 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:59.954 INFO 9 --- [host-check-agent-status3,7f2e90c78787e280,dddda17c5cb2e7fe] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:55:59.954 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:55:59.955 INFO 9 --- [host-check-agent-status5,7f2e90c78787e280,9dada0ba3a302e72] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:55:59.955 INFO 9 --- [host-check-clockdiff1,0bd89432d60f5070,1298421dcf424bfd] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002159 -1 -1 , error= 2025-09-16 13:55:59.955 INFO 9 --- [host-check-clockdiff3,0bd89432d60f5070,491aa8cbb0b6924f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002159 -1 -1 , error= 2025-09-16 13:55:59.955 INFO 9 --- [host-check-agent-status4,7f2e90c78787e280,84dc9a3da353994c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:55:59.955 INFO 9 --- [host-check-agent-status1,7f2e90c78787e280,02dfd85e3720f840] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:55:59.955 INFO 9 --- [host-check-agent-status6,7f2e90c78787e280,6bab4932e825a787] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:59.956 INFO 9 --- [host-check-agent-status2,7f2e90c78787e280,31371a87e35532e8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:55:59.956 INFO 9 --- [host-check-clockdiff4,0bd89432d60f5070,3464780351dd8da6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002159 -1 -1 , error= 2025-09-16 13:55:59.956 INFO 9 --- [host-check-clockdiff6,0bd89432d60f5070,9171f1faf06d83ee] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002159 -1 -1 , error= 2025-09-16 13:55:59.956 INFO 9 --- [host-check-clockdiff5,0bd89432d60f5070,646f32ea45fae784] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002159 -1 -1 , error= 2025-09-16 13:55:59.956 INFO 9 --- [host-check-clockdiff2,0bd89432d60f5070,305ac764bba59d8d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002159 -2 -2 , error= 2025-09-16 13:55:59.969 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:55:59.969 INFO 9 --- [host-check-agent-status3,7f2e90c78787e280,dddda17c5cb2e7fe] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:55:59.969 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:55:59.970 INFO 9 --- [host-check-agent-status5,7f2e90c78787e280,9dada0ba3a302e72] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:55:59.970 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:55:59.970 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:55:59.970 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:55:59.971 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:55:59.971 INFO 9 --- [host-check-agent-status1,7f2e90c78787e280,02dfd85e3720f840] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:55:59.971 INFO 9 --- [host-check-agent-status2,7f2e90c78787e280,31371a87e35532e8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:55:59.971 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:55:59.969887425+08:00 2025-09-16 13:55:59.971 INFO 9 --- [host-check-agent-status6,7f2e90c78787e280,6bab4932e825a787] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:55:59.971 INFO 9 --- [host-check-agent-status4,7f2e90c78787e280,84dc9a3da353994c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:55:59.971+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:55:59.970519091+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:55:59.970677717+08:00 2025-09-16 13:55:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:55:59.971258242+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:55:59.972+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:55:59.971337244+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:55:59.972+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:55:59.972+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:55:59.972+08:00 2025-09-16 13:55:59.972 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:55:59.971747763+08:00 2025-09-16 13:55:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:55:59.973 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:55:59.972+08:00 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status5,7f2e90c78787e280,9dada0ba3a302e72] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status3,7f2e90c78787e280,dddda17c5cb2e7fe] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status5,7f2e90c78787e280,9dada0ba3a302e72] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status2,7f2e90c78787e280,31371a87e35532e8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status5,7f2e90c78787e280,9dada0ba3a302e72] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status2,7f2e90c78787e280,31371a87e35532e8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status3,7f2e90c78787e280,dddda17c5cb2e7fe] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status2,7f2e90c78787e280,31371a87e35532e8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:55:59.974 INFO 9 --- [host-check-agent-status3,7f2e90c78787e280,dddda17c5cb2e7fe] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:55:59.975 INFO 9 --- [host-check-agent-status6,7f2e90c78787e280,6bab4932e825a787] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:55:59.975 INFO 9 --- [host-check-agent-status6,7f2e90c78787e280,6bab4932e825a787] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:55:59.975 INFO 9 --- [host-check-agent-status6,7f2e90c78787e280,6bab4932e825a787] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:55:59.975 INFO 9 --- [host-check-agent-status1,7f2e90c78787e280,02dfd85e3720f840] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:55:59.975 INFO 9 --- [host-check-agent-status1,7f2e90c78787e280,02dfd85e3720f840] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:55:59.975 INFO 9 --- [host-check-agent-status1,7f2e90c78787e280,02dfd85e3720f840] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:55:59.976 INFO 9 --- [host-check-agent-status4,7f2e90c78787e280,84dc9a3da353994c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:55:59.976 INFO 9 --- [host-check-agent-status4,7f2e90c78787e280,84dc9a3da353994c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:55:59.976 INFO 9 --- [host-check-agent-status4,7f2e90c78787e280,84dc9a3da353994c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:55:59.978 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:55:59.971+08:00 and status AVAILABLE 2025-09-16 13:55:59.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:55:59.978 INFO 9 --- [ocp-schedules-28,ed21218df04215ea,99921be0b3b71ab5] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:55:59.979 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:55:59.972+08:00 and status AVAILABLE 2025-09-16 13:55:59.981 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:55:59.972+08:00 and status AVAILABLE 2025-09-16 13:55:59.981 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:55:59.981 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:55:59.972+08:00 and status AVAILABLE 2025-09-16 13:55:59.982 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:55:59.972+08:00 and status AVAILABLE 2025-09-16 13:55:59.983 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:55:59.983 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:55:59.984 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:55:59.972+08:00 and status AVAILABLE 2025-09-16 13:55:59.985 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:55:59.986 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:55:59.987 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:55:59.987 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:55:59.988 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:55:59.989 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:55:59.989 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:55:59.990 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:55:59.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:55:59.990 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:55:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:55:59.991 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:55:59.992 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:55:59.992 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:55:59.992 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:55:59.993 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:55:59.993 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:00.002 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:00.004 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:00.005 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:56:00.004174+08:00, lastProcessTime=2025-09-16T13:55:50.004+08:00 2025-09-16 13:56:00.007 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:00.007 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:00.007 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:00.029 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:00.030 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:56:00.033 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:56:00.033 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:00.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:56:00.034 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:56:00.035 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:56:00.035 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:56:00.036 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:56:00.037 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:56:00.039 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:56:00.041 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:56:00.041 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:56:00.042 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:56:00.042 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:56:00.053 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:00.054 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:00.055 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:00.057 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:00.058 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:00.058 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:00.067 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:00.069 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:00.069 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:56:00.075 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:00.078 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:56:00.079 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:00.082 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:56:00.082 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:56:00.083 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:56:00.085 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:56:00.088 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:56:00.089 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:56:00.089 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:56:00.090 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:56:00.091 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:56:00.091 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:56:00.095 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:56:00.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:00.097 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:56:00.101 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:00.102 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:00.103 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:00.103 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:00.105 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:00.108 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:00.114 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.114 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:00.127 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:56:00.004174+08:00 2025-09-16 13:56:00.128 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:56:00.129 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.129 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:00.129 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:56:00.130 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:56:00.134 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:56:00.134 INFO 9 --- [host-check-host-status2,edb230e8bfac6e85,521111a713c953f0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:56:00.136 INFO 9 --- [host-check-host-status3,edb230e8bfac6e85,cd9521adfb9c865f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:56:00.136 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:56:00.137 INFO 9 --- [host-check-host-status5,edb230e8bfac6e85,639ca1b57e17504f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:56:00.141 INFO 9 --- [host-check-host-status4,edb230e8bfac6e85,41ced69e82ae9af3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:56:00.142 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:56:00.143 INFO 9 --- [host-check-host-status1,edb230e8bfac6e85,cf1519da13cb6d6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:56:00.146 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.146 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:00.149 INFO 9 --- [host-check-host-status6,edb230e8bfac6e85,9511d6a299d06698] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:56:00.160 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.160 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:00.185 INFO 9 --- [ocp-async-7,98e493a3ba94a2f5,1e7e5798e6b98bbb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:56:00.189 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.189 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:00.204 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.204 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:00.217 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.217 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:00.232 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:00.245 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:00.247 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:00.247 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:56:00.252 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:56:00.255 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:56:00.258 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:00.259 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:00.272 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:56:00.333 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:56:00.346 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:00.350 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:00.351 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:56:00.364 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:56:00.364 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:56:00.364 INFO 9 --- [ocp-schedules-20,90ee5cb49d5a5982,f80963069438f05a] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:56:00.541 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:00.542 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:00.797 WARN 9 --- [ocp-async-9,b684d512e5a6df48,4bdcd4265e88b302] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:00.797 INFO 9 --- [ocp-async-3,089772bbe727d34e,b6a808d14d9e6435] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:00.852 INFO 9 --- [ocp-schedules-14,6c859bae4675e769,5423c97991d20e79] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:56:01.408 INFO 9 --- [ocp-schedules-30,229c30aa6e220312,91aa5b3318c5d662] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:56:01.413 WARN 9 --- [scanner-1378699-1,229c30aa6e220312,655fc51ae00d9aa6] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:56:01.424 INFO 9 --- [alarm-detect-17,229c30aa6e220312,315b2f7ec1bf6dd4] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:56:01.425 INFO 9 --- [alarm-detect-10,229c30aa6e220312,23d7018f1599a839] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:56:01.425 INFO 9 --- [alarm-detect-11,229c30aa6e220312,f311ec0bfaeefd99] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:56:01.438 INFO 9 --- [alarm-detect-12,229c30aa6e220312,143a0236e2e5df00] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:56:01.636 INFO 9 --- [prometheus-minute-schedule-1,0b69f87042c374f1,487e2f94999c986f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:01.640 INFO 9 --- [prometheus-minute-schedule-1,0b69f87042c374f1,487e2f94999c986f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:02.797 WARN 9 --- [ocp-async-7,2b8fd295d4eb854d,5093e9686d12f750] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:02.797 INFO 9 --- [ocp-async-8,f888d2b5754ed0ea,b1ab36659dda46f8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:03.542 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:03.543 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:04.636 INFO 9 --- [prometheus-minute-schedule-1,6099623bdcf62142,a89d8361bc4dd03a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:04.640 INFO 9 --- [prometheus-minute-schedule-1,6099623bdcf62142,a89d8361bc4dd03a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:04.797 INFO 9 --- [ocp-async-10,013e94b70edfe5c6,973349e7d57caa6d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:04.798 WARN 9 --- [ocp-async-6,92d307b27b7630a5,8263d8b9c6693503] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:04.801 INFO 9 --- [ocp-schedules-23,6d32bba44aae5ae7,69aa26c0ef7a98cb] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:56:06.543 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:06.544 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:06.798 INFO 9 --- [ocp-async-1,a35740529b525143,8fd0a6dd14d4fb8d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:06.798 WARN 9 --- [ocp-async-9,96b86e3e6db4e40c,6b4cd8ebd737aa1b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:07.636 INFO 9 --- [prometheus-minute-schedule-1,77acc51619e38fac,7dc44d6966e0bb39] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:07.639 INFO 9 --- [prometheus-minute-schedule-1,77acc51619e38fac,7dc44d6966e0bb39] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:08.798 WARN 9 --- [ocp-async-7,f27cb423ef31f74b,9116f7b71acb4279] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:08.798 INFO 9 --- [ocp-async-4,751844d318469026,8e8e0d6becab5667] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:09.122 INFO 9 --- [ocp-schedules-9,84c1944bacaac528,3ceef6107367ab30] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:56:09.124 INFO 9 --- [ocp-schedules-9,84c1944bacaac528,3ceef6107367ab30] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:56:09.544 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:09.544 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:10.003 INFO 9 --- [ocp-schedules-7,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:56:10.003 INFO 9 --- [ocp-schedules-15,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:56:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:56:10.004124+08:00, lastProcessTime=2025-09-16T13:56:00.004174+08:00 2025-09-16 13:56:10.114 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:56:10.004124+08:00 2025-09-16 13:56:10.185 INFO 9 --- [ocp-async-9,2366a24275989a07,e73fa8ca0b1369c4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:56:10.298 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:56:10.636 INFO 9 --- [prometheus-minute-schedule-1,4e5ad56daaa19e4d,34ff7bf609c339d1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:10.639 INFO 9 --- [prometheus-minute-schedule-1,4e5ad56daaa19e4d,34ff7bf609c339d1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:10.798 WARN 9 --- [ocp-async-2,523a6cccb02a1912,ca11bc0454cc2b88] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:10.798 INFO 9 --- [ocp-async-10,6da5bd50f9e6d54e,098e20ce8ea4ada9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:11.441 INFO 9 --- [ocp-schedules-8,c2a761565aae2f11,36ab28292412e7b2] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:56:11.445 WARN 9 --- [scanner-1379739-1,c2a761565aae2f11,ede1974607addae0] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:56:11.743 INFO 9 --- [metric-archive-async-4,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002100, nodeCount=460, affectRows=460 2025-09-16 13:56:12.544 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:12.545 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:12.798 WARN 9 --- [ocp-async-5,60e908d22b01dbcb,8abc30111428eb4f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:12.798 INFO 9 --- [ocp-async-1,055b65fc1031ec33,41f9efed7a8e8076] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:13.187 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002100, nodeCount=1000, affectRows=1000 2025-09-16 13:56:13.190 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002100, nodeCount=1000, validCount=996 2025-09-16 13:56:13.214 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002100, nodeCount=1000, affectRows=1000 2025-09-16 13:56:13.216 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002100, nodeCount=1000, validCount=998 2025-09-16 13:56:13.227 ERROR 9 --- [metric-archive-second-3,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697862) Duplicate entry '824401952431849472-1758002040' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697862) Duplicate entry '824401952431849472-1758002040' for key 'PRIMARY' 2025-09-16 13:56:13.636 INFO 9 --- [prometheus-minute-schedule-1,87c35457ec31087e,3d6dabd5629efeea] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:13.639 INFO 9 --- [prometheus-minute-schedule-1,87c35457ec31087e,3d6dabd5629efeea] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:14.230 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002100, nodeCount=853, affectRows=853 2025-09-16 13:56:14.232 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002100, nodeCount=853, validCount=849 2025-09-16 13:56:14.508 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002100, nodeCount=1000, affectRows=1000 2025-09-16 13:56:14.510 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002100, nodeCount=991, validCount=947 2025-09-16 13:56:14.690 INFO 9 --- [ocp-schedules-16,4f087c22ce80035e,8cd51468f7b09231] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:56:14.695 INFO 9 --- [ocp-schedules-16,4f087c22ce80035e,8cd51468f7b09231] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:56:14.695 INFO 9 --- [ocp-schedules-16,4f087c22ce80035e,8cd51468f7b09231] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:56:14.798 WARN 9 --- [ocp-async-3,b4efc68f59227374,2127e86e3758076b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:14.798 INFO 9 --- [ocp-async-4,514096e9336b1e9a,316757d475f8d567] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:14.805 INFO 9 --- [ocp-schedules-1,53278792de69c8ee,a7d4a26d2fb65a3e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:56:15.545 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:15.546 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:16.636 INFO 9 --- [prometheus-minute-schedule-1,744487f663fd5e36,302b477f5bb5d625] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:16.639 INFO 9 --- [prometheus-minute-schedule-1,744487f663fd5e36,302b477f5bb5d625] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:16.798 WARN 9 --- [ocp-async-2,ef36af888cd026e4,5ca13429ed83894f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:16.798 INFO 9 --- [ocp-async-6,d4b4b05bfc1d5f57,b89b49d99e072578] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:18.546 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:18.547 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:18.798 WARN 9 --- [ocp-async-10,c396af3c284b2bfa,1a1f872eb1dc83af] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:18.798 INFO 9 --- [ocp-async-9,227f0ad77e9ab437,ae5b941fccb8baae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:19.128 INFO 9 --- [ocp-schedules-4,d335479b2abe2bf1,8f07d417f1379837] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:56:19.131 INFO 9 --- [ocp-schedules-4,d335479b2abe2bf1,8f07d417f1379837] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:56:19.636 INFO 9 --- [prometheus-minute-schedule-1,c1f275ad5d1d77ad,46908be8f8038dd2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:19.639 INFO 9 --- [prometheus-minute-schedule-1,c1f275ad5d1d77ad,46908be8f8038dd2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:56:20.004356+08:00, lastProcessTime=2025-09-16T13:56:10.004124+08:00 2025-09-16 13:56:20.121 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:56:20.004356+08:00 2025-09-16 13:56:20.185 INFO 9 --- [ocp-async-4,8ef5701783fb585b,29ff0d5298cc2413] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:56:20.636 INFO 9 --- [prometheus-cache-monitor1,0b4bc6d7639b24a6,066430e3609d012d] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:56:20.636 INFO 9 --- [prometheus-cache-monitor1,0b4bc6d7639b24a6,066430e3609d012d] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:56:20.798 WARN 9 --- [ocp-async-3,2e4f36051774affb,d80f41b6681b223b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:20.798 INFO 9 --- [ocp-async-2,4ad613170430a684,03947e27925ad762] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:21.467 INFO 9 --- [ocp-schedules-6,8d6f9c03d18e143c,f6a6014135a7771b] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:56:21.472 WARN 9 --- [scanner-1379861-1,8d6f9c03d18e143c,9f663c871e2d0331] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:56:21.483 INFO 9 --- [alarm-detect-17,8d6f9c03d18e143c,e21191882ba19594] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:56:21.485 INFO 9 --- [alarm-detect-5,8d6f9c03d18e143c,ca12f122f0f99faa] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:56:21.485 INFO 9 --- [alarm-detect-10,8d6f9c03d18e143c,48f9c5a212f9308f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:56:21.497 INFO 9 --- [alarm-detect-4,8d6f9c03d18e143c,c52f46f97d25ce11] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:56:21.547 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:21.547 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:22.636 INFO 9 --- [prometheus-minute-schedule-1,3704f3ca61e0ff01,84cf04b75c5d91b1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:22.639 INFO 9 --- [prometheus-minute-schedule-1,3704f3ca61e0ff01,84cf04b75c5d91b1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:22.799 WARN 9 --- [ocp-async-4,e3327f9c6b9b8400,0b55b0e58113819a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:22.799 INFO 9 --- [ocp-async-6,2f5d72f09272d30a,f153d96230932a4d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:24.547 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:24.548 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:24.799 WARN 9 --- [ocp-async-10,a8b57ae4f0bd0594,1df6bd8f34682c10] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:24.799 INFO 9 --- [ocp-async-9,8a8b57a38e8a08be,6fe7630ac9e4cf2c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:24.808 INFO 9 --- [ocp-schedules-15,99c9dd2d9d76a15a,efabc78e40932d91] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:56:25.636 INFO 9 --- [prometheus-minute-schedule-1,83c70a84ddca53a2,230e5b472f87c7e4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:25.639 INFO 9 --- [prometheus-minute-schedule-1,83c70a84ddca53a2,230e5b472f87c7e4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:26.799 WARN 9 --- [ocp-async-1,5a726916e59e1db3,893645c551e1783d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:26.799 INFO 9 --- [ocp-async-7,1685def41d3be295,6c42b8beb0d86ba6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:27.548 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:27.549 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:28.636 INFO 9 --- [prometheus-minute-schedule-1,df0969653b74a31a,253dbfd436134031] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:28.639 INFO 9 --- [prometheus-minute-schedule-1,df0969653b74a31a,253dbfd436134031] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:28.799 WARN 9 --- [ocp-async-2,8f60316ff3377701,85a8b98bc101242b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:28.799 INFO 9 --- [ocp-async-8,53cdedb78a210888,eed88a6cea364668] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:29.135 INFO 9 --- [ocp-schedules-21,696c53b089808eae,1629884d85537e43] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:56:29.137 INFO 9 --- [ocp-schedules-21,696c53b089808eae,1629884d85537e43] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:56:29.938 INFO 9 --- [ocp-schedules-20,d893db786b9d87c9,3ef7d4719c4d688d] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:56:29.941 INFO 9 --- [ocp-schedules-4,05b44df5066afd25,602b98149222cc80] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:56:29.941 INFO 9 --- [ocp-schedules-13,a4aaa3c2e83d5791,ba0816b57239a697] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:56:29.942 INFO 9 --- [ocp-schedules-12,a23bcc7513152de3,08f61c54ae4a25b9] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:56:29.943 INFO 9 --- [ocp-schedules-13,a4aaa3c2e83d5791,ba0816b57239a697] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:29.943 INFO 9 --- [ocp-schedules-12,a23bcc7513152de3,08f61c54ae4a25b9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:29.944 INFO 9 --- [ocp-schedules-12,a23bcc7513152de3,08f61c54ae4a25b9] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:56:29.944 INFO 9 --- [ocp-schedules-15,ee31d15c257019ff,f460cee5e9876785] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:29.944 INFO 9 --- [ocp-schedules-4,05b44df5066afd25,602b98149222cc80] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:29.944 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:56:29.944 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:56:29.944 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:56:29.944 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:56:29.944 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:56:29.944 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:56:29.945 INFO 9 --- [ocp-schedules-6,41757487f3d939ee,2ec39d06f30bb8e9] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:29.945 INFO 9 --- [host-check-agent-status1,41757487f3d939ee,2afecbfd3db9a303] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:56:29.945 INFO 9 --- [host-check-agent-status2,41757487f3d939ee,0cc0e39de3306937] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:56:29.945 INFO 9 --- [host-check-agent-status3,41757487f3d939ee,59d33250e5cf4142] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:56:29.945 INFO 9 --- [host-check-agent-status4,41757487f3d939ee,60ba5f530bcc849f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:56:29.945 INFO 9 --- [host-check-agent-status5,41757487f3d939ee,ad9b3d6f77431d56] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:56:29.945 INFO 9 --- [host-check-agent-status6,41757487f3d939ee,bed5fce83a3a80ac] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:56:29.946 INFO 9 --- [ocp-schedules-1,133b929ce4bf1938,c52b83e53b46d9d6] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:29.946 INFO 9 --- [host-check-clockdiff1,133b929ce4bf1938,6c6555dc13bc26fb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:56:29.947 INFO 9 --- [host-check-clockdiff2,133b929ce4bf1938,451c4a01d59a9da7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:56:29.947 INFO 9 --- [host-check-clockdiff3,133b929ce4bf1938,5ccebc1481b309aa] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:56:29.947 INFO 9 --- [host-check-clockdiff4,133b929ce4bf1938,6432b40b336b88df] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:56:29.947 INFO 9 --- [host-check-clockdiff5,133b929ce4bf1938,86322aef327fea0a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:56:29.947 INFO 9 --- [host-check-clockdiff6,133b929ce4bf1938,cfc7636a4bb67129] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:56:29.947 INFO 9 --- [ocp-schedules-11,82884125120be53a,33e9bd1986bce4b3] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:56:29.947 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:56:29.947 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:56:29.948 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:56:29.948 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:56:29.948 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:56:29.948 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:29.948 INFO 9 --- [host-check-agent-status1,41757487f3d939ee,2afecbfd3db9a303] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:56:29.948 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:29.949 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:56:29.949 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:56:29.949 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:56:29.949 INFO 9 --- [host-check-agent-status3,41757487f3d939ee,59d33250e5cf4142] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:56:29.952 INFO 9 --- [host-check-agent-status4,41757487f3d939ee,60ba5f530bcc849f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:56:29.952 INFO 9 --- [host-check-agent-status5,41757487f3d939ee,ad9b3d6f77431d56] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:56:29.953 INFO 9 --- [host-check-agent-status2,41757487f3d939ee,0cc0e39de3306937] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:56:29.953 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:29.953 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:56:29.953 INFO 9 --- [host-check-agent-status6,41757487f3d939ee,bed5fce83a3a80ac] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:29.955 INFO 9 --- [host-check-agent-status2,41757487f3d939ee,0cc0e39de3306937] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:56:29.955 INFO 9 --- [host-check-agent-status4,41757487f3d939ee,60ba5f530bcc849f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:56:29.955 INFO 9 --- [host-check-clockdiff3,133b929ce4bf1938,5ccebc1481b309aa] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002189 -1 -1 , error= 2025-09-16 13:56:29.955 INFO 9 --- [host-check-clockdiff4,133b929ce4bf1938,6432b40b336b88df] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002189 -1 -1 , error= 2025-09-16 13:56:29.955 INFO 9 --- [host-check-agent-status5,41757487f3d939ee,ad9b3d6f77431d56] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:56:29.955 INFO 9 --- [host-check-clockdiff2,133b929ce4bf1938,451c4a01d59a9da7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002189 -1 -1 , error= 2025-09-16 13:56:29.955 INFO 9 --- [host-check-agent-status1,41757487f3d939ee,2afecbfd3db9a303] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:56:29.955 INFO 9 --- [host-check-agent-status3,41757487f3d939ee,59d33250e5cf4142] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:29.955 INFO 9 --- [host-check-clockdiff5,133b929ce4bf1938,86322aef327fea0a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002189 -1 -1 , error= 2025-09-16 13:56:29.957 INFO 9 --- [host-check-clockdiff1,133b929ce4bf1938,6c6555dc13bc26fb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002189 -1 -1 , error= 2025-09-16 13:56:29.957 INFO 9 --- [host-check-agent-status6,41757487f3d939ee,bed5fce83a3a80ac] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:29.959 INFO 9 --- [host-check-clockdiff6,133b929ce4bf1938,cfc7636a4bb67129] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002189 -1 -1 , error= 2025-09-16 13:56:29.962 INFO 9 --- [ocp-schedules-16,83c035e61c5f96b2,a3a63f35a05fce38] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:56:29.963 INFO 9 --- [ocp-schedules-26,70ab8139a9986195,63b8983b0bef66e7] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:56:29.967 INFO 9 --- [ocp-schedules-16,83c035e61c5f96b2,a3a63f35a05fce38] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:56:29.969 INFO 9 --- [ocp-schedules-26,70ab8139a9986195,63b8983b0bef66e7] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:56:29.971 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:56:29.972 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:56:29.972 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:56:29.973 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:56:29.973 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:56:29.971737865+08:00 2025-09-16 13:56:29.973 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:56:29.973 INFO 9 --- [host-check-agent-status1,41757487f3d939ee,2afecbfd3db9a303] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:56:29.973 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:56:29.973 INFO 9 --- [host-check-agent-status2,41757487f3d939ee,0cc0e39de3306937] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:56:29.973 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:56:29.973+08:00 2025-09-16 13:56:29.974 INFO 9 --- [host-check-agent-status5,41757487f3d939ee,ad9b3d6f77431d56] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:56:29.974 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:56:29.972503408+08:00 2025-09-16 13:56:29.974 INFO 9 --- [host-check-agent-status4,41757487f3d939ee,60ba5f530bcc849f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:56:29.974 INFO 9 --- [host-check-agent-status3,41757487f3d939ee,59d33250e5cf4142] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:56:29.974 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:56:29.974+08:00 2025-09-16 13:56:29.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:29.974 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:56:29.973378251+08:00 2025-09-16 13:56:29.974 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:56:29.973648766+08:00 2025-09-16 13:56:29.974 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:56:29.974+08:00 2025-09-16 13:56:29.975 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:56:29.974+08:00 2025-09-16 13:56:29.975 INFO 9 --- [host-check-agent-status6,41757487f3d939ee,bed5fce83a3a80ac] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:56:29.975 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:56:29.974166101+08:00 2025-09-16 13:56:29.975 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:56:29.973+08:00 and status AVAILABLE 2025-09-16 13:56:29.975 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:56:29.973788424+08:00 2025-09-16 13:56:29.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:56:29.975 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:56:29.975+08:00 2025-09-16 13:56:29.975 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:56:29.975+08:00 2025-09-16 13:56:29.976 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:56:29.974+08:00 and status AVAILABLE 2025-09-16 13:56:29.976 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:56:29.974+08:00 and status AVAILABLE 2025-09-16 13:56:29.976 INFO 9 --- [host-check-agent-status3,41757487f3d939ee,59d33250e5cf4142] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:56:29.976 INFO 9 --- [host-check-agent-status3,41757487f3d939ee,59d33250e5cf4142] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:56:29.976 INFO 9 --- [host-check-agent-status3,41757487f3d939ee,59d33250e5cf4142] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:56:29.976 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:56:29.974+08:00 and status AVAILABLE 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status2,41757487f3d939ee,0cc0e39de3306937] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status2,41757487f3d939ee,0cc0e39de3306937] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status2,41757487f3d939ee,0cc0e39de3306937] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status5,41757487f3d939ee,ad9b3d6f77431d56] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status5,41757487f3d939ee,ad9b3d6f77431d56] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status5,41757487f3d939ee,ad9b3d6f77431d56] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:56:29.977 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:56:29.975+08:00 and status AVAILABLE 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status1,41757487f3d939ee,2afecbfd3db9a303] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status1,41757487f3d939ee,2afecbfd3db9a303] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status1,41757487f3d939ee,2afecbfd3db9a303] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:56:29.977 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:56:29.975+08:00 and status AVAILABLE 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status4,41757487f3d939ee,60ba5f530bcc849f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status4,41757487f3d939ee,60ba5f530bcc849f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:56:29.977 INFO 9 --- [host-check-agent-status4,41757487f3d939ee,60ba5f530bcc849f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:56:29.978 INFO 9 --- [host-check-agent-status6,41757487f3d939ee,bed5fce83a3a80ac] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:56:29.978 INFO 9 --- [host-check-agent-status6,41757487f3d939ee,bed5fce83a3a80ac] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:56:29.978 INFO 9 --- [host-check-agent-status6,41757487f3d939ee,bed5fce83a3a80ac] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:56:29.978 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:56:29.978 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:56:29.978 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:56:29.978 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:56:29.980 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:56:29.980 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:56:29.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:56:29.981 INFO 9 --- [ocp-schedules-13,a4aaa3c2e83d5791,ba0816b57239a697] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:56:29.984 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:56:29.984 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:56:29.984 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:56:29.984 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:29.985 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:29.985 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:56:29.985 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:56:29.985 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:29.986 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:56:29.986 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:56:29.987 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:56:29.987 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:56:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:29.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:56:29.998 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:29.998 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:29.998 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:30.000 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:30.001 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:30.002 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:56:30.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:56:30.004751+08:00, lastProcessTime=2025-09-16T13:56:20.004356+08:00 2025-09-16 13:56:30.025 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:56:30.027 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:56:30.027 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:56:30.028 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:56:30.029 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:56:30.030 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:56:30.031 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:30.031 INFO 9 --- [ocp-schedules-21,bacc85d3e629960e,c4f13de5c432ca45] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:56:30.031 INFO 9 --- [ocp-schedules-21,bacc85d3e629960e,c4f13de5c432ca45] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:56:30.032 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:30.033 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:56:30.033 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:56:30.033 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:56:30.034 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:56:30.035 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:56:30.035 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:56:30.036 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:56:30.045 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:30.046 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:30.046 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:30.047 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:30.047 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:30.048 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:56:30.067 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:30.069 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:30.069 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:56:30.073 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:30.073 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:56:30.075 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:56:30.075 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:56:30.075 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:56:30.076 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:56:30.076 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:30.079 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:56:30.080 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:56:30.081 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:56:30.082 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:56:30.082 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:56:30.082 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:56:30.085 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:56:30.087 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:56:30.091 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.091 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:30.092 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:30.093 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:30.095 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:30.095 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:30.095 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:30.098 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:56:30.101 INFO 9 --- [prometheus-second-schedule-1,2a0e36fa21966b04,ecb68e37234f8326] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:56:30.108 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.108 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:30.119 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:56:30.121 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:56:30.121 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:56:30.122 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:56:30.123 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:56:30.123 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.123 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:30.126 INFO 9 --- [host-check-host-status3,ee31d15c257019ff,7b251540274c408f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:56:30.128 INFO 9 --- [host-check-host-status5,ee31d15c257019ff,ee2b93a529c061d4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:56:30.128 INFO 9 --- [host-check-host-status4,ee31d15c257019ff,19254bf1b604ba73] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:56:30.128 INFO 9 --- [host-check-host-status2,ee31d15c257019ff,16564078f5a0445f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:56:30.129 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:56:30.129 INFO 9 --- [host-check-host-status1,ee31d15c257019ff,33b7c80ee50285f0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:56:30.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:56:30.004751+08:00 2025-09-16 13:56:30.136 INFO 9 --- [host-check-host-status6,ee31d15c257019ff,9c3feff22950d5dc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:56:30.139 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.139 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:30.153 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.153 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:30.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:30.182 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.182 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:30.185 INFO 9 --- [ocp-async-3,fb80a0853a0572cb,75978c13055a1fdb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:56:30.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:56:30.211 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.211 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:56:30.228 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:56:30.242 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:30.244 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:30.244 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:56:30.249 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:56:30.252 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:56:30.255 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:30.256 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:30.270 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:56:30.276 INFO 9 --- [ocp-schedules-2,67d99d8949b5b8c2,176584e76d5a5c0c] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:56:30.277 INFO 9 --- [ocp-schedules-2,67d99d8949b5b8c2,176584e76d5a5c0c] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:30.277 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:56:30.277 INFO 9 --- [ocp-schedules-2,67d99d8949b5b8c2,176584e76d5a5c0c] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:56:30.283 INFO 9 --- [ocp-schedules-10,5e3ca6467dd5d67c,b308b727a2f2228b] c.o.o.s.common.scheduled.HostSchedules : Check host version schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:30.283 INFO 9 --- [ocp-schedules-10,5e3ca6467dd5d67c,b308b727a2f2228b] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-version, skip execute 2025-09-16 13:56:30.330 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:56:30.345 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:30.346 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:30.347 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:56:30.361 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:56:30.361 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:56:30.361 INFO 9 --- [ocp-schedules-4,05b44df5066afd25,602b98149222cc80] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:56:30.406 INFO 9 --- [ocp-schedules-12,84c087db6c0b61d8,c0abec1baa97abcc] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:56:30.549 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:30.549 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:30.593 INFO 9 --- [ocp-schedules-1,0406073cf68c89af,8fe31f50ca6f61ac] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:56:30.595 INFO 9 --- [ocp-schedules-1,0406073cf68c89af,8fe31f50ca6f61ac] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:56:30.595 INFO 9 --- [ocp-schedules-1,0406073cf68c89af,8fe31f50ca6f61ac] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:56:30.799 WARN 9 --- [ocp-async-10,cab4205483dd476a,acb020afbe67bbb1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:30.799 INFO 9 --- [ocp-async-1,7635a809d206452d,2071618a36e987ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:30.854 INFO 9 --- [ocp-schedules-21,b4ff7de2dae3aa57,3929346fb4877c35] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:56:30.984 INFO 9 --- [ocp-schedules-7,d5129254a970dd52,a76b239988750f4c] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:56:30.984 INFO 9 --- [ocp-schedules-7,d5129254a970dd52,a76b239988750f4c] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:56:31.484 INFO 9 --- [ocp-schedules-17,d4877b0202df150c,913a598c0b422c0c] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:56:31.484 INFO 9 --- [ocp-schedules-17,d4877b0202df150c,913a598c0b422c0c] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002191 2025-09-16 13:56:31.487 INFO 9 --- [ocp-schedules-17,d4877b0202df150c,913a598c0b422c0c] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:56:31.500 INFO 9 --- [ocp-schedules-28,883f520c3f935532,cb087e672f450b2e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:56:31.504 WARN 9 --- [scanner-1380021-1,883f520c3f935532,2f39835bcf03d784] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:56:31.636 INFO 9 --- [prometheus-minute-schedule-1,c6fac4f11e1f339c,8d08721e1e477184] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:31.639 INFO 9 --- [prometheus-minute-schedule-1,c6fac4f11e1f339c,8d08721e1e477184] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:31.652 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2025-09-16 13:56:31.652 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2025-09-16 13:56:31.654 INFO 9 --- [ocp-schedules-10,be851e07d55ed91b,ab84543c8286b7c4] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:56:31.656 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2025-09-16 13:56:31.656 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: binlogQueryCache 2025-09-16 13:56:31.656 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.c.cache.helper.BinlogQueryCache : Init binlog cache. 2025-09-16 13:56:31.662 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.c.cache.helper.BinlogQueryCache : Finish init binlog cache. 2025-09-16 13:56:31.662 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2025-09-16 13:56:31.662 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2025-09-16 13:56:31.669 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2025-09-16 13:56:31.669 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2025-09-16 13:56:31.669 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2025-09-16 13:56:31.672 INFO 9 --- [ocp-schedules-14,c6a2255109023ff3,2c6abc2ba84b6240] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2025-09-16 13:56:31.701 INFO 9 --- [ocp-schedules-4,86bcaf153ed7d6d5,c482cf8e5332220d] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:56:31.701 INFO 9 --- [ocp-schedules-4,86bcaf153ed7d6d5,c482cf8e5332220d] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 13:56:31.704 INFO 9 --- [ocp-schedules-4,86bcaf153ed7d6d5,c482cf8e5332220d] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:56:31.704 INFO 9 --- [ocp-schedules-4,86bcaf153ed7d6d5,c482cf8e5332220d] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:56:31.706 INFO 9 --- [ocp-schedules-4,86bcaf153ed7d6d5,c482cf8e5332220d] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:56:31.706 INFO 9 --- [ocp-schedules-4,86bcaf153ed7d6d5,c482cf8e5332220d] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:56:31.710 INFO 9 --- [ocp-schedules-20,acbf13d6648cce8f,7007f303baec2c92] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:56:31.782 INFO 9 --- [ocp-schedules-12,c2edf3874c667691,c700734743fa77af] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:56:31.783 INFO 9 --- [ocp-schedules-12,c2edf3874c667691,c700734743fa77af] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:31.797 INFO 9 --- [ocp-schedules-12,c2edf3874c667691,c700734743fa77af] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:56:32.799 WARN 9 --- [ocp-async-1,34396475fba6c509,bf1d73f1194b8df0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:32.799 INFO 9 --- [ocp-async-1,b27c3dfa7b1cd757,3b76f087caf7248f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:33.453 INFO 9 --- [ocp-schedules-11,1ad5e063c1090f70,8ef78c4d1e82afc6] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:56:33.550 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:33.550 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:33.586 INFO 9 --- [ocp-schedules-30,a3f85fd1226f3933,1cf17f12da783008] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:56:33.586+08:00, clusters=[1] 2025-09-16 13:56:33.587 INFO 9 --- [ocp-schedules-30,a3f85fd1226f3933,1cf17f12da783008] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:56:34.153 INFO 9 --- [ocp-schedules-28,7ca75fe5bb01df6e,5b47be76a2df7b73] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:56:34.153 INFO 9 --- [ocp-schedules-28,7ca75fe5bb01df6e,5b47be76a2df7b73] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:56:34.155 INFO 9 --- [ocp-schedules-28,7ca75fe5bb01df6e,5b47be76a2df7b73] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:56:34.171 INFO 9 --- [ocp-schedules-28,7ca75fe5bb01df6e,5b47be76a2df7b73] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:56:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:56:34.636 INFO 9 --- [prometheus-minute-schedule-1,cfd7170f41feec1b,b22fce7241b5efb8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:34.639 INFO 9 --- [prometheus-minute-schedule-1,cfd7170f41feec1b,b22fce7241b5efb8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:34.697 INFO 9 --- [ocp-schedules-14,5fe8795033c30373,45c625da7e6a07ad] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:56:34.702 INFO 9 --- [ocp-schedules-14,5fe8795033c30373,45c625da7e6a07ad] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:56:34.702 INFO 9 --- [ocp-schedules-14,5fe8795033c30373,45c625da7e6a07ad] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:56:34.799 WARN 9 --- [ocp-async-1,b36e5791199e9636,1a37bf2e50fe22ac] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:34.799 INFO 9 --- [ocp-async-6,6ed9461647682382,865ded69cce0494e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:34.811 INFO 9 --- [ocp-schedules-29,4c749d1de355fe6b,3e25cfb5d6d6fe51] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:56:35.684 INFO 9 --- [ocp-schedules-17,a1ccfa6e87ced9f2,4a0daba3d05b1d7b] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:56:35.684+08:00, clusters=[1] 2025-09-16 13:56:35.687 INFO 9 --- [ocp-schedules-17,a1ccfa6e87ced9f2,4a0daba3d05b1d7b] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:56:36.551 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:36.551 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:36.799 WARN 9 --- [ocp-async-6,48c5b2ed72bbf8e7,12d11d170ddd99c5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:36.799 INFO 9 --- [ocp-async-3,9db7ac4daef7947e,feba9b9896b8ae18] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:37.636 INFO 9 --- [prometheus-minute-schedule-1,3858fa2fd0488604,dc2b7b41b0c2b6c8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:37.639 INFO 9 --- [prometheus-minute-schedule-1,3858fa2fd0488604,dc2b7b41b0c2b6c8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:37.874 INFO 9 --- [ocp-schedules-20,fe89193e07a73169,5f918922f888fc88] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:56:37.876 INFO 9 --- [ocp-schedules-20,fe89193e07a73169,5f918922f888fc88] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:37.894 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:37.895 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:56:37.908 INFO 9 --- [ocp-schedules-20,fe89193e07a73169,5f918922f888fc88] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:56:38.799 WARN 9 --- [ocp-async-3,b232fb38bea2abb3,fd8a0f844188bb48] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:38.800 INFO 9 --- [ocp-async-4,04fc1e7490eec4b5,2c12bdbb7d82b8ae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:39.142 INFO 9 --- [ocp-schedules-18,c8bbaaf07937f7b6,5add9c5c838fb2cf] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:56:39.144 INFO 9 --- [ocp-schedules-18,c8bbaaf07937f7b6,5add9c5c838fb2cf] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:56:39.551 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:39.552 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:39.949 INFO 9 --- [ocp-schedules-21,b2bce5688a5032d0,cf0512928d8e6bf0] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:56:39.949 INFO 9 --- [ocp-schedules-21,b2bce5688a5032d0,cf0512928d8e6bf0] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:56:39.964 INFO 9 --- [ocp-schedules-9,d086ed276d0e5265,8d2d0ca37d031b60] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:39.964 INFO 9 --- [ocp-schedules-9,d086ed276d0e5265,8d2d0ca37d031b60] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:56:39.965 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:56:39.965 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:56:39.965 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:56:39.965 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:56:39.966 INFO 9 --- [Collect all tenants major compactions3,b2bce5688a5032d0,462b3dfc1ae2a749] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:56:39.966 INFO 9 --- [Collect all tenants major compactions2,b2bce5688a5032d0,d6036d63bb6d07a8] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:56:39.966 INFO 9 --- [Collect all tenants major compactions1,b2bce5688a5032d0,04d3190785e7fdef] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:56:39.968 INFO 9 --- [ocp-schedules-9,d086ed276d0e5265,8d2d0ca37d031b60] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:56:39.968 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:56:39.968 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:56:39.969 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:39.969 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:56:39.969 INFO 9 --- [ocp-schedules-9,d086ed276d0e5265,8d2d0ca37d031b60] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:56:39.969 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:56:39.969 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:56:39.969 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:39.970 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:56:39.982 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:56:39.984 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:56:39.985 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:56:39.985 INFO 9 --- [ocp-schedules-9,d086ed276d0e5265,8d2d0ca37d031b60] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:56:39.985 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:56:39.986 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:56:39.988 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:56:39.989 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:39.989 INFO 9 --- [Collect all tenants major compactions2,b2bce5688a5032d0,d6036d63bb6d07a8] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:39.990 INFO 9 --- [Collect all tenants major compactions2,b2bce5688a5032d0,d6036d63bb6d07a8] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:56:39.990 INFO 9 --- [Collect all tenants major compactions3,b2bce5688a5032d0,462b3dfc1ae2a749] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:39.991 INFO 9 --- [Collect all tenants major compactions1,b2bce5688a5032d0,04d3190785e7fdef] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:39.992 INFO 9 --- [Collect all tenants major compactions3,b2bce5688a5032d0,462b3dfc1ae2a749] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:56:39.993 INFO 9 --- [Collect all tenants major compactions1,b2bce5688a5032d0,04d3190785e7fdef] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:56:39.997 INFO 9 --- [Collect all tenants major compactions3,b2bce5688a5032d0,462b3dfc1ae2a749] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:56:39.997 INFO 9 --- [Collect all tenants major compactions1,b2bce5688a5032d0,04d3190785e7fdef] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:56:39.998 INFO 9 --- [Collect all tenants major compactions2,b2bce5688a5032d0,d6036d63bb6d07a8] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:56:39.998 INFO 9 --- [ocp-schedules-21,b2bce5688a5032d0,cf0512928d8e6bf0] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:56:40.002 INFO 9 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:56:40.002 INFO 9 --- [ocp-schedules-11,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:56:40.002 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:56:40.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:56:40.002449+08:00, lastProcessTime=2025-09-16T13:56:30.004751+08:00 2025-09-16 13:56:40.004 INFO 9 --- [ocp-schedules-9,d086ed276d0e5265,8d2d0ca37d031b60] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:56:40.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:56:40.002449+08:00 2025-09-16 13:56:40.185 INFO 9 --- [ocp-async-10,b2ed05fd494d3150,0984e6da0505ed7d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:56:40.636 INFO 9 --- [prometheus-minute-schedule-1,a03593fe79c977b1,3c7c7bf7c5dd923a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:40.639 INFO 9 --- [prometheus-minute-schedule-1,a03593fe79c977b1,3c7c7bf7c5dd923a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:40.800 WARN 9 --- [ocp-async-8,004e40781d41b86d,edaac2de70ceeb27] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:40.800 INFO 9 --- [ocp-async-6,9ab69469720618d8,7006db230d8e160c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:41.527 INFO 9 --- [ocp-schedules-12,854e2eab933c41fd,010d7b25f340ac6c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:56:41.532 WARN 9 --- [scanner-1380151-1,854e2eab933c41fd,885f06c3d301a491] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:56:41.542 INFO 9 --- [alarm-detect-13,854e2eab933c41fd,f1e820ee7a9fa56e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:56:41.545 INFO 9 --- [alarm-detect-20,854e2eab933c41fd,ca1888f887d19f25] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:56:41.545 INFO 9 --- [alarm-detect-17,854e2eab933c41fd,b9285a5cc8a8326a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:56:41.557 INFO 9 --- [alarm-detect-13,854e2eab933c41fd,d257f33efea87e4c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:56:42.450 INFO 9 --- [ocp-schedules-30,dcab911ebfcb5bfa,d6b1e306a08f098d] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:56:42.450 INFO 9 --- [ocp-schedules-30,dcab911ebfcb5bfa,d6b1e306a08f098d] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:56:42.486 INFO 9 --- [ocp-schedules-30,dcab911ebfcb5bfa,d6b1e306a08f098d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:42.487 INFO 9 --- [ocp-schedules-30,dcab911ebfcb5bfa,d6b1e306a08f098d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:56:42.552 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:42.553 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:42.800 WARN 9 --- [ocp-async-6,5427ffd7c8ef970e,211e802deb5225ae] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:42.800 INFO 9 --- [ocp-async-3,5cd138b9ba433847,c131dbad06bd5208] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:43.636 INFO 9 --- [prometheus-minute-schedule-1,1edfd68f1eca450e,2ff437446a0c6ca2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:43.639 INFO 9 --- [prometheus-minute-schedule-1,1edfd68f1eca450e,2ff437446a0c6ca2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:44.800 WARN 9 --- [ocp-async-2,23dd5c1ecadc66ec,f36bac5fa9095538] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:44.800 INFO 9 --- [ocp-async-4,bf87918f489ced93,94b28d93d2260cad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:44.814 INFO 9 --- [ocp-schedules-20,9250b00468b425ec,bcfafb7f9b2dae21] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:56:45.400 INFO 9 --- [ocp-schedules-18,f52bc5820eafb0ec,2ac7107bb6169774] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:56:45.401 INFO 9 --- [ocp-schedules-18,f52bc5820eafb0ec,2ac7107bb6169774] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:45.446 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:56:45.447 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.449 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:56:45.477 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.477 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:56:45.500 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.501 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:56:45.526 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.527 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:56:45.532 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.532 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:56:45.553 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:45.553 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:45.555 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.556 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:56:45.579 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.580 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:56:45.584 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.585 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:56:45.609 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.610 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:56:45.633 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.633 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:56:45.654 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.656 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:56:45.657 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.658 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:56:45.658 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.659 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:56:45.660 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.660 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:56:45.661 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.662 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:56:45.662 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.663 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:56:45.679 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.680 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:56:45.681 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.681 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:56:45.682 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.683 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:56:45.699 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:56:45.702 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:56:45.729 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:56:45.731 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:45.731 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:56:45.759 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:56:45.759 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:56:45.759 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:56:45.759 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:56:45.759 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:56:45.759 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:56:45.761 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:56:45.761 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:56:45.761 INFO 9 --- [ocp-schedules-18,f52bc5820eafb0ec,2ac7107bb6169774] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:56:46.636 INFO 9 --- [prometheus-minute-schedule-1,30a38fd432789a05,a0d06308d1939fdf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:46.640 INFO 9 --- [prometheus-minute-schedule-1,30a38fd432789a05,a0d06308d1939fdf] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:46.800 WARN 9 --- [ocp-async-1,e7b392bda4b28b69,4ec03f7defa53d17] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:46.800 INFO 9 --- [ocp-async-1,ea75b0a9eb8f755c,70ab75fba0a57d77] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:56:46,990 |-INFO in ReconfigureOnChangeTask(born:1758002146990) - Empty watch file list. Disabling 2025-09-16 13:56:47.130 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,a3f275cec8588266,6eb7409c72283914] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=a3f275cec8588266, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:56:47.130 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,a3f275cec8588266,6eb7409c72283914] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=a3f275cec8588266, duration=1 ms] 2025-09-16 13:56:48.554 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:48.554 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:48.800 WARN 9 --- [ocp-async-10,5d102336b8bb57c2,c16c3a8afa5f65e3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:48.800 INFO 9 --- [ocp-async-9,335448f572f74d1c,7af142feeba44592] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:49.148 INFO 9 --- [ocp-schedules-6,c2e2d6338265dbae,30bc05de103ebe04] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:56:49.150 INFO 9 --- [ocp-schedules-6,c2e2d6338265dbae,30bc05de103ebe04] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:56:49.237 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:49.238 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:56:49.239 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:49.239 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:56:49.240 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:56:49.255 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:56:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:56:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:56:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:56:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:56:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:54:30, target=2025-09-16T13:52:30, granule=120000ms, delay=120000ms) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:54:30, target=2025-09-16T13:52:30, granule=120000ms, delay=120000ms) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:54:30, target=2025-09-16T13:52:30, granule=120000ms, delay=120000ms) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:54:30, target=2025-09-16T13:52:30, granule=120000ms, delay=120000ms) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:56:49.270 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:56:49.271 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=0) - not enough cached interval (source=2025-09-16T13:54:30, target=2025-09-16T13:52:30, granule=120000ms, delay=120000ms) 2025-09-16 13:56:49.271 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:52:30, target=2025-09-16T13:47:30, granule=600000ms, delay=300000ms) 2025-09-16 13:56:49.271 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=31ms, period=120000ms 2025-09-16 13:56:49.636 INFO 9 --- [prometheus-minute-schedule-1,d30f7aea536b1a02,1e27aa78e01b237b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:49.639 INFO 9 --- [prometheus-minute-schedule-1,d30f7aea536b1a02,1e27aa78e01b237b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:56:50.003573+08:00, lastProcessTime=2025-09-16T13:56:40.002449+08:00 2025-09-16 13:56:50.123 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:56:50.003573+08:00 2025-09-16 13:56:50.185 INFO 9 --- [ocp-async-5,a83ebc12c83d5523,5a3ba400bae2349f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:56:50.800 WARN 9 --- [ocp-async-2,3fedf68a95293aac,898b1a8ff93b0f52] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:50.800 INFO 9 --- [ocp-async-4,71b7413348faa3bb,21ef809be2b090be] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:51.554 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:51.555 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:51.561 INFO 9 --- [ocp-schedules-29,dc6ecf1abd7b9a63,0d73e8f8ba6ed904] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:56:51.566 WARN 9 --- [scanner-1380313-1,dc6ecf1abd7b9a63,53379f4c16babd0c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:56:52.636 INFO 9 --- [prometheus-minute-schedule-1,033931e410e7a09e,b80abce2cc8fff51] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:52.639 INFO 9 --- [prometheus-minute-schedule-1,033931e410e7a09e,b80abce2cc8fff51] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:52.800 WARN 9 --- [ocp-async-5,a6a298967000146e,19655389deb6e5c2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:52.800 INFO 9 --- [ocp-async-5,af2a274c1e9b0354,5323688620e88420] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:54.555 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:54.556 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:54.703 INFO 9 --- [ocp-schedules-21,e0a2061ae61d0be3,75322d8fbddaceca] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:56:54.708 INFO 9 --- [ocp-schedules-21,e0a2061ae61d0be3,75322d8fbddaceca] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:56:54.708 INFO 9 --- [ocp-schedules-21,e0a2061ae61d0be3,75322d8fbddaceca] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:56:54.800 WARN 9 --- [ocp-async-10,8b405e67559fd53d,57cf81fbe190e0d9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:54.800 INFO 9 --- [ocp-async-6,ae2bd8ed3244b726,fb61beb1dc555119] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:54.817 INFO 9 --- [ocp-schedules-24,01e558cb5b0e4fd4,591bfe96be7315d0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:56:55.636 INFO 9 --- [prometheus-minute-schedule-1,e037e517e08ce346,d60cc201b76b3b78] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:55.639 INFO 9 --- [prometheus-minute-schedule-1,e037e517e08ce346,d60cc201b76b3b78] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:56.801 WARN 9 --- [ocp-async-3,955e184de61cac6a,089c4b59ca953608] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:56.801 INFO 9 --- [ocp-async-2,df93fc7aed812898,777dfcc0e7c89d34] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:57.556 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:56:57.557 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:56:58.636 INFO 9 --- [prometheus-minute-schedule-1,9c32871da278285c,7b663b49a4783c3e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002220, interval=60 2025-09-16 13:56:58.639 INFO 9 --- [prometheus-minute-schedule-1,9c32871da278285c,7b663b49a4783c3e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:56:58.801 INFO 9 --- [ocp-async-4,0c7e6c98feef3561,deccefed0b64ab05] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:56:58.801 WARN 9 --- [ocp-async-1,05a7e98569aa009c,c4fd8f251314a3e8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:56:59.155 INFO 9 --- [ocp-schedules-10,b2ebb92d8074f44b,c2becb0d1926fc54] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:56:59.157 INFO 9 --- [ocp-schedules-10,b2ebb92d8074f44b,c2becb0d1926fc54] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:56:59.938 INFO 9 --- [ocp-schedules-15,ebd393b75a3cd0a1,c44967886a6c644d] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:56:59.941 INFO 9 --- [ocp-schedules-23,f978789023993eaf,cdf6a2cd39f5032a] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:56:59.941 INFO 9 --- [ocp-schedules-8,23bbae8b147bc7bd,e926883469ad9127] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:56:59.942 INFO 9 --- [ocp-schedules-4,3a5c6bb8a72f7eed,0cbb04c65f1a9e52] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:56:59.942 INFO 9 --- [ocp-schedules-23,f978789023993eaf,cdf6a2cd39f5032a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:59.943 INFO 9 --- [ocp-schedules-8,23bbae8b147bc7bd,e926883469ad9127] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:59.943 INFO 9 --- [ocp-schedules-4,3a5c6bb8a72f7eed,0cbb04c65f1a9e52] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:56:59.944 INFO 9 --- [ocp-schedules-4,3a5c6bb8a72f7eed,0cbb04c65f1a9e52] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:56:59.944 INFO 9 --- [ocp-schedules-6,d8c50909f08903a7,304ba37684fc92ff] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:59.944 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:56:59.944 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:56:59.944 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:56:59.944 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:56:59.944 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:56:59.944 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:56:59.945 INFO 9 --- [ocp-schedules-25,988bd3550cf491b7,4ddd9439418fb8be] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:59.945 INFO 9 --- [ocp-schedules-24,50e06fe303a28b84,8db9267f796bceb6] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:56:59.945 INFO 9 --- [host-check-clockdiff1,988bd3550cf491b7,bfa047c3df964e60] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:56:59.945 INFO 9 --- [host-check-clockdiff2,988bd3550cf491b7,419ae58477e2d375] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:56:59.945 INFO 9 --- [host-check-clockdiff3,988bd3550cf491b7,5909ac9b4ca6f31d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:56:59.946 INFO 9 --- [host-check-clockdiff4,988bd3550cf491b7,9b0532ea47f5551e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:56:59.946 INFO 9 --- [host-check-agent-status1,50e06fe303a28b84,f5fc6c54e844d4dd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:56:59.946 INFO 9 --- [host-check-clockdiff5,988bd3550cf491b7,fa32ea183c064605] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:56:59.946 INFO 9 --- [host-check-agent-status2,50e06fe303a28b84,6398a645e5b0c74b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:56:59.946 INFO 9 --- [host-check-agent-status3,50e06fe303a28b84,be3b5a95d36ec172] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:56:59.946 INFO 9 --- [host-check-clockdiff6,988bd3550cf491b7,29bf24246aad6a45] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:56:59.946 INFO 9 --- [host-check-agent-status4,50e06fe303a28b84,e24f223dd75e5a68] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:56:59.946 INFO 9 --- [host-check-agent-status5,50e06fe303a28b84,c81b4389f217141f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:56:59.946 INFO 9 --- [host-check-agent-status6,50e06fe303a28b84,1f7a6c4cae673e4c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:56:59.947 INFO 9 --- [ocp-schedules-21,e5d56a516f7369ed,320fc9cd2f4dee35] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:56:59.951 INFO 9 --- [host-check-clockdiff1,988bd3550cf491b7,bfa047c3df964e60] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002219 -1 -1 , error= 2025-09-16 13:56:59.953 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:56:59.953 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:56:59.953 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:56:59.953 INFO 9 --- [host-check-clockdiff4,988bd3550cf491b7,9b0532ea47f5551e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002219 -1 -1 , error= 2025-09-16 13:56:59.953 INFO 9 --- [host-check-clockdiff2,988bd3550cf491b7,419ae58477e2d375] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002219 -2 -2 , error= 2025-09-16 13:56:59.953 INFO 9 --- [host-check-clockdiff5,988bd3550cf491b7,fa32ea183c064605] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002219 -1 -1 , error= 2025-09-16 13:56:59.955 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:56:59.955 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:59.955 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:56:59.955 INFO 9 --- [host-check-clockdiff3,988bd3550cf491b7,5909ac9b4ca6f31d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002219 -1 -1 , error= 2025-09-16 13:56:59.955 INFO 9 --- [host-check-agent-status6,50e06fe303a28b84,1f7a6c4cae673e4c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:59.956 INFO 9 --- [host-check-agent-status1,50e06fe303a28b84,f5fc6c54e844d4dd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:56:59.956 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:56:59.956 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:56:59.957 INFO 9 --- [host-check-agent-status2,50e06fe303a28b84,6398a645e5b0c74b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:56:59.957 INFO 9 --- [host-check-agent-status3,50e06fe303a28b84,be3b5a95d36ec172] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:56:59.957 INFO 9 --- [host-check-agent-status5,50e06fe303a28b84,c81b4389f217141f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:56:59.957 INFO 9 --- [host-check-agent-status4,50e06fe303a28b84,e24f223dd75e5a68] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:56:59.957 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:59.957 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:56:59.957 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:59.957 INFO 9 --- [host-check-clockdiff6,988bd3550cf491b7,29bf24246aad6a45] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002219 -1 -1 , error= 2025-09-16 13:56:59.958 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:56:59.958 INFO 9 --- [host-check-agent-status5,50e06fe303a28b84,c81b4389f217141f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:56:59.958 INFO 9 --- [host-check-agent-status6,50e06fe303a28b84,1f7a6c4cae673e4c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:59.958 INFO 9 --- [host-check-agent-status1,50e06fe303a28b84,f5fc6c54e844d4dd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:56:59.958 INFO 9 --- [host-check-agent-status3,50e06fe303a28b84,be3b5a95d36ec172] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:59.958 INFO 9 --- [host-check-agent-status2,50e06fe303a28b84,6398a645e5b0c74b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:56:59.959 INFO 9 --- [host-check-agent-status4,50e06fe303a28b84,e24f223dd75e5a68] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:56:59.972 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:56:59.972 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:56:59.972 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:56:59.972 INFO 9 --- [host-check-agent-status1,50e06fe303a28b84,f5fc6c54e844d4dd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:56:59.972 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:56:59.972 INFO 9 --- [host-check-agent-status6,50e06fe303a28b84,1f7a6c4cae673e4c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:56:59.972 INFO 9 --- [host-check-agent-status5,50e06fe303a28b84,c81b4389f217141f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:56:59.973 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:56:59.973 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:56:59.973 INFO 9 --- [host-check-agent-status2,50e06fe303a28b84,6398a645e5b0c74b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:56:59.973 INFO 9 --- [host-check-agent-status3,50e06fe303a28b84,be3b5a95d36ec172] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:56:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:59.973 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:56:59.972689986+08:00 2025-09-16 13:56:59.973 INFO 9 --- [host-check-agent-status4,50e06fe303a28b84,e24f223dd75e5a68] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:56:59.973 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:56:59.972360824+08:00 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:56:59.973145575+08:00 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:56:59.973+08:00 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:56:59.973+08:00 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:56:59.972928512+08:00 2025-09-16 13:56:59.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:56:59.974+08:00 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:56:59.973619094+08:00 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:56:59.973088449+08:00 2025-09-16 13:56:59.974 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:56:59.974+08:00 2025-09-16 13:56:59.975 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:56:59.974+08:00 2025-09-16 13:56:59.975 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:56:59.974+08:00 2025-09-16 13:56:59.976 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:56:59.973+08:00 and status AVAILABLE 2025-09-16 13:56:59.976 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:56:59.973+08:00 and status AVAILABLE 2025-09-16 13:56:59.976 INFO 9 --- [host-check-agent-status5,50e06fe303a28b84,c81b4389f217141f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:56:59.976 INFO 9 --- [host-check-agent-status5,50e06fe303a28b84,c81b4389f217141f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:56:59.976 INFO 9 --- [host-check-agent-status5,50e06fe303a28b84,c81b4389f217141f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:56:59.976 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:56:59.974+08:00 and status AVAILABLE 2025-09-16 13:56:59.976 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:56:59.974+08:00 and status AVAILABLE 2025-09-16 13:56:59.976 INFO 9 --- [host-check-agent-status1,50e06fe303a28b84,f5fc6c54e844d4dd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:56:59.976 INFO 9 --- [host-check-agent-status1,50e06fe303a28b84,f5fc6c54e844d4dd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:56:59.976 INFO 9 --- [host-check-agent-status1,50e06fe303a28b84,f5fc6c54e844d4dd] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:56:59.977 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:56:59.974+08:00 and status AVAILABLE 2025-09-16 13:56:59.977 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:56:59.974+08:00 and status AVAILABLE 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status6,50e06fe303a28b84,1f7a6c4cae673e4c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status6,50e06fe303a28b84,1f7a6c4cae673e4c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status6,50e06fe303a28b84,1f7a6c4cae673e4c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status2,50e06fe303a28b84,6398a645e5b0c74b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status2,50e06fe303a28b84,6398a645e5b0c74b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status2,50e06fe303a28b84,6398a645e5b0c74b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status3,50e06fe303a28b84,be3b5a95d36ec172] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status3,50e06fe303a28b84,be3b5a95d36ec172] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:56:59.977 INFO 9 --- [host-check-agent-status3,50e06fe303a28b84,be3b5a95d36ec172] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:56:59.978 INFO 9 --- [host-check-agent-status4,50e06fe303a28b84,e24f223dd75e5a68] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:56:59.978 INFO 9 --- [host-check-agent-status4,50e06fe303a28b84,e24f223dd75e5a68] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:56:59.978 INFO 9 --- [host-check-agent-status4,50e06fe303a28b84,e24f223dd75e5a68] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:56:59.979 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:56:59.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:56:59.979 INFO 9 --- [ocp-schedules-8,23bbae8b147bc7bd,e926883469ad9127] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:56:59.980 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:56:59.980 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:56:59.980 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:56:59.980 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:56:59.980 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:56:59.985 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:56:59.985 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:56:59.986 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:56:59.986 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:56:59.986 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:56:59.987 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:56:59.987 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:56:59.987 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:56:59.987 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:56:59.987 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:56:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:56:59.988 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:56:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:56:59.988 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:00.000 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:00.001 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:00.001 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:00.002 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:00.002 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:00.002 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:00.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:57:00.005507+08:00, lastProcessTime=2025-09-16T13:56:50.003573+08:00 2025-09-16 13:57:00.028 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:57:00.029 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:57:00.029 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:57:00.029 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:00.029 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:57:00.030 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:57:00.031 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:00.031 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:57:00.034 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:57:00.035 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:57:00.035 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:57:00.036 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:57:00.037 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:57:00.038 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:57:00.042 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:57:00.048 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:00.049 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:00.049 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:00.049 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:00.050 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:00.053 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:00.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:00.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:00.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:57:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:00.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:57:00.075 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:00.076 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:57:00.077 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:57:00.077 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:57:00.078 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:57:00.080 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:57:00.083 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:57:00.083 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:57:00.083 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:57:00.084 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:57:00.085 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:57:00.087 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:57:00.090 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:57:00.091 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.091 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:00.096 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:00.096 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:00.112 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:00.112 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:00.115 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:00.117 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:00.122 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:57:00.122 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.123 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:00.123 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:57:00.129 INFO 9 --- [host-check-host-status5,d8c50909f08903a7,0dd997461c8ecacc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:57:00.130 INFO 9 --- [host-check-host-status4,d8c50909f08903a7,3da1fe08d125cb5f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:57:00.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.138 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:00.140 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:57:00.140 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:57:00.143 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:57:00.147 INFO 9 --- [host-check-host-status3,d8c50909f08903a7,3276ba95dfbd6718] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:57:00.147 INFO 9 --- [host-check-host-status2,d8c50909f08903a7,d339d52fee1ed321] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:57:00.148 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:57:00.148 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:57:00.005507+08:00 2025-09-16 13:57:00.149 INFO 9 --- [host-check-host-status1,d8c50909f08903a7,fd75dcae67ce7cdf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:57:00.154 INFO 9 --- [host-check-host-status6,d8c50909f08903a7,277694037b4e4282] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:57:00.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:00.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:00.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:00.185 INFO 9 --- [ocp-async-3,35219bcd0ab58d3c,02b1b99b2ddd68ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:57:00.197 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:00.212 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.212 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:00.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:00.241 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:00.254 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:00.256 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:00.256 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:57:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:57:00.264 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:57:00.267 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:00.268 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:00.281 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:57:00.343 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:57:00.356 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:00.358 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:00.359 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:57:00.373 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:57:00.373 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758001642801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:57:00.373 INFO 9 --- [ocp-schedules-23,f978789023993eaf,cdf6a2cd39f5032a] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:57:00.557 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:00.557 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:00.801 INFO 9 --- [ocp-async-10,427e6254200b61ea,6242700c9cf24622] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:00.801 WARN 9 --- [ocp-async-9,b3d0a4a9d333d27f,d09e287aab3fd86a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:00.856 INFO 9 --- [ocp-schedules-25,ecaa32540179be1b,63ed4233c68e40af] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:57:01.587 INFO 9 --- [ocp-schedules-18,e508e504836c9863,5696b850a7b0607a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:57:01.593 WARN 9 --- [scanner-1380444-1,e508e504836c9863,d1e7c36a4ea9539a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:57:01.603 INFO 9 --- [alarm-detect-12,e508e504836c9863,fd253fc3aebd4bf5] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:57:01.605 INFO 9 --- [alarm-detect-8,e508e504836c9863,7fcbdc7e0e1d1174] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:57:01.605 INFO 9 --- [alarm-detect-10,e508e504836c9863,fd4c25a073b532a8] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:57:01.617 INFO 9 --- [alarm-detect-11,e508e504836c9863,fb15bf6d550e13f7] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:57:01.636 INFO 9 --- [prometheus-minute-schedule-1,74464ad92cb104ec,9e2b42c70fed6f0c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:01.639 INFO 9 --- [prometheus-minute-schedule-1,74464ad92cb104ec,9e2b42c70fed6f0c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:02.801 INFO 9 --- [ocp-async-3,16f3b809814b0e11,bf64b7a24079ec5a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:02.801 WARN 9 --- [ocp-async-7,d7a409abaa74c56f,194f989fb7651dbf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:03.557 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:03.558 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:04.636 INFO 9 --- [prometheus-minute-schedule-1,3059e6aff507664e,7f8aa022f3185f4e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:04.639 INFO 9 --- [prometheus-minute-schedule-1,3059e6aff507664e,7f8aa022f3185f4e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:04.801 INFO 9 --- [ocp-async-1,ae6aef2332cea253,f4aff37019bd3a3a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:04.801 WARN 9 --- [ocp-async-8,f4e949b59bd6da8e,ff9e6c641f8e0a8d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:04.821 INFO 9 --- [ocp-schedules-29,3e53ad309d47a22b,714c9649c6607347] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:57:06.558 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:06.559 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:06.801 INFO 9 --- [ocp-async-5,8ea15cec7f4f1702,b427e75e88d9d753] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:06.801 WARN 9 --- [ocp-async-9,c27ffaf4d7dd78f6,0da919cbe563748b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:07.636 INFO 9 --- [prometheus-minute-schedule-1,65b09d62e6c5d3c9,2c31c976458b4095] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:07.639 INFO 9 --- [prometheus-minute-schedule-1,65b09d62e6c5d3c9,2c31c976458b4095] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:08.801 INFO 9 --- [ocp-async-10,89746c1b53ad5fc3,11ee006dc8e5b611] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:08.801 WARN 9 --- [ocp-async-7,47ad64b28597114f,72aa960a49bc3c18] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:09.162 INFO 9 --- [ocp-schedules-20,385924e9cc7625a2,48314feb9111b9c4] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:57:09.164 INFO 9 --- [ocp-schedules-20,385924e9cc7625a2,48314feb9111b9c4] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:57:09.559 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:09.560 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:10.002 INFO 9 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:57:10.003 INFO 9 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:57:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:57:10.003769+08:00, lastProcessTime=2025-09-16T13:57:00.005507+08:00 2025-09-16 13:57:10.111 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:57:10.003769+08:00 2025-09-16 13:57:10.186 INFO 9 --- [ocp-async-9,2fdc447c0d9090ee,eb3c7df5c240c005] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:57:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:57:10.636 INFO 9 --- [prometheus-minute-schedule-1,26f5aaef01e74416,d84ec40886356405] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:10.639 INFO 9 --- [prometheus-minute-schedule-1,26f5aaef01e74416,d84ec40886356405] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:10.801 WARN 9 --- [ocp-async-4,316f34f3b7f0dd81,13f47f052130433e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:10.801 INFO 9 --- [ocp-async-8,39c80afc67bac257,3b616231d06f78b2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:11.620 INFO 9 --- [ocp-schedules-14,985ce11c6e7ff3c4,df27d8c2639251ad] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:57:11.624 WARN 9 --- [scanner-1381481-1,985ce11c6e7ff3c4,dfc5155090ece745] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:57:11.742 INFO 9 --- [metric-archive-async-4,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002160, nodeCount=222, affectRows=222 2025-09-16 13:57:11.742 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002160, nodeCount=241, affectRows=241 2025-09-16 13:57:12.560 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:12.560 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:12.802 WARN 9 --- [ocp-async-6,08174e47438d3bd9,9148dc473d8494d5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:12.802 INFO 9 --- [ocp-async-9,e337b6cf37ff908f,9ad5538fa2ced4e9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:13.636 INFO 9 --- [prometheus-minute-schedule-1,7bb5e05ca433023f,3d2b3a77758642d4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:13.640 INFO 9 --- [prometheus-minute-schedule-1,7bb5e05ca433023f,3d2b3a77758642d4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:14.260 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002160, nodeCount=1000, affectRows=1000 2025-09-16 13:57:14.262 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002160, nodeCount=1000, validCount=996 2025-09-16 13:57:14.287 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002160, nodeCount=1000, affectRows=1000 2025-09-16 13:57:14.290 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002160, nodeCount=1000, validCount=998 2025-09-16 13:57:14.301 ERROR 9 --- [metric-archive-second-5,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221689329) Duplicate entry '824401952612204544-1758002100' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221689329) Duplicate entry '824401952612204544-1758002100' for key 'PRIMARY' 2025-09-16 13:57:14.432 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002160, nodeCount=853, affectRows=853 2025-09-16 13:57:14.434 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002160, nodeCount=852, validCount=850 2025-09-16 13:57:14.709 INFO 9 --- [ocp-schedules-20,b9c2c4519576747d,992e7fd845335689] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:57:14.714 INFO 9 --- [ocp-schedules-20,b9c2c4519576747d,992e7fd845335689] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:57:14.714 INFO 9 --- [ocp-schedules-20,b9c2c4519576747d,992e7fd845335689] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:57:14.802 WARN 9 --- [ocp-async-2,6565bd1d12987e7c,1501b6d44c5b0845] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:14.802 INFO 9 --- [ocp-async-7,fd79065e16fc784f,f5fa424c73cdc98a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:14.825 INFO 9 --- [ocp-schedules-3,7b4c0f4c89fb6664,6cc3c7b301f4478f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:57:15.561 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:15.561 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:15.589 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002160, nodeCount=1000, affectRows=1000 2025-09-16 13:57:15.591 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002160, nodeCount=992, validCount=946 2025-09-16 13:57:16.636 INFO 9 --- [prometheus-minute-schedule-1,d22fd2726afff8e8,adfe1b2e87de1d37] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:16.639 INFO 9 --- [prometheus-minute-schedule-1,d22fd2726afff8e8,adfe1b2e87de1d37] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:16.802 INFO 9 --- [ocp-async-3,c1b36bcaa6377551,91f01db9b30f67fe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:16.802 WARN 9 --- [ocp-async-4,c6ca5ceb12343174,0e29e4bf246ffa52] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:18.562 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:18.562 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:18.802 WARN 9 --- [ocp-async-8,e0000984d79d56ef,f1ec642d380d7d61] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:18.802 INFO 9 --- [ocp-async-6,a7996235bb82c877,202eea9eab823c80] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:19.169 INFO 9 --- [ocp-schedules-24,401e30225ff275cc,015bee0ded1fca99] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:57:19.171 INFO 9 --- [ocp-schedules-24,401e30225ff275cc,015bee0ded1fca99] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:57:19.636 INFO 9 --- [prometheus-minute-schedule-1,a79ee7ac4cf854a3,c79e3380dd369d06] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:19.639 INFO 9 --- [prometheus-minute-schedule-1,a79ee7ac4cf854a3,c79e3380dd369d06] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:57:20.003530+08:00, lastProcessTime=2025-09-16T13:57:10.003769+08:00 2025-09-16 13:57:20.122 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:57:20.003530+08:00 2025-09-16 13:57:20.186 INFO 9 --- [ocp-async-4,2f31f5ef66cdcd00,a5f9d74311942d13] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:57:20.636 INFO 9 --- [prometheus-cache-monitor1,4e4c16f861641b9c,09cba5394043bb68] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:57:20.636 INFO 9 --- [prometheus-cache-monitor1,4e4c16f861641b9c,09cba5394043bb68] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:57:20.802 WARN 9 --- [ocp-async-2,88e2c94632608378,5322bec382aaa648] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:20.802 INFO 9 --- [ocp-async-10,7660791f8b8213ff,458145498ccaa9d5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:21.562 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:21.563 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:21.646 INFO 9 --- [ocp-schedules-20,429456a92ca1c06d,0d9f35aa8823662f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:57:21.651 WARN 9 --- [scanner-1381610-1,429456a92ca1c06d,306105e98e0dbb66] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:57:21.661 INFO 9 --- [alarm-detect-18,429456a92ca1c06d,9a9b814ecd6c4992] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:57:21.663 INFO 9 --- [alarm-detect-16,429456a92ca1c06d,408413c40c5a423e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:57:21.663 INFO 9 --- [alarm-detect-7,429456a92ca1c06d,744eba6dd2b5268d] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:57:21.675 INFO 9 --- [alarm-detect-18,429456a92ca1c06d,ca615b10293591c9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:57:22.636 INFO 9 --- [prometheus-minute-schedule-1,1a352a07a589b4d5,a6f64d4eef764f5a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:22.639 INFO 9 --- [prometheus-minute-schedule-1,1a352a07a589b4d5,a6f64d4eef764f5a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:22.800 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,8b398db5202d5dfa,32860e61547e2bce] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=zhengqi&version=2&ObClusterId=1, client=10.232.140.0, traceId=8b398db5202d5dfa, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(String,Long,String,Long,Integer,String), args=zhengqi,1,2,{"ObRegion":"zhengqi","ObCluster":"zhengqi","ObRegionId":1,"ObClusterId":1,"Type":"PRIMARY","timestamp":1758002242797588,"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},] 2025-09-16 13:57:22.802 WARN 9 --- [ocp-async-4,df05906ce22e1693,078763a230868b57] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:22.802 INFO 9 --- [ocp-async-1,a04e964c35cc6e4c,3d6c61cfd6383610] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:22.814 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,8b398db5202d5dfa,32860e61547e2bce] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Put cluster info ClusterCacheInfo(clusterName=zhengqi, obClusterId=1, rootServerJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, groupName=zhengqi, obproxyClusters=null, tenantInfos=[]) into config server cache 2025-09-16 13:57:22.814 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,8b398db5202d5dfa,32860e61547e2bce] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Put cluster info into config server cache success 2025-09-16 13:57:22.814 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,8b398db5202d5dfa,32860e61547e2bce] c.o.ocp.configurl.ConfigUrlService : updateRootServer, clusterName=zhengqi, clusterId=1, affectRows=1 2025-09-16 13:57:22.814 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,8b398db5202d5dfa,32860e61547e2bce] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /services client=10.232.140.0, traceId=8b398db5202d5dfa, duration=14 ms] 2025-09-16 13:57:24.563 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:24.564 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:24.802 WARN 9 --- [ocp-async-8,f5ff1861415c8d28,21f68f2afeacade1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:24.802 INFO 9 --- [ocp-async-5,486f03d39bdf1c6a,3a0ad48e77e94b67] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:24.829 INFO 9 --- [ocp-schedules-25,7f18cbe4e4ebcca1,e4ded3ef88f24d0a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:57:25.636 INFO 9 --- [prometheus-minute-schedule-1,7656ac79bce7de9d,c66796bde24ebaca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:25.639 INFO 9 --- [prometheus-minute-schedule-1,7656ac79bce7de9d,c66796bde24ebaca] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:26.802 WARN 9 --- [ocp-async-9,faa8b0d7e65d9aa3,79420eadc130ef18] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:26.802 INFO 9 --- [ocp-async-2,c9d2aea074abc3c8,c627ccfb934385be] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:27.564 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:27.565 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:28.636 INFO 9 --- [prometheus-minute-schedule-1,b390854dcb7839b9,10630bc187203b4d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:28.639 INFO 9 --- [prometheus-minute-schedule-1,b390854dcb7839b9,10630bc187203b4d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:28.802 WARN 9 --- [ocp-async-10,debd91ee2dcc6c94,9b14e32ef8087762] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:28.802 INFO 9 --- [ocp-async-3,6c3278db910dc456,1821c3a295f63589] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:29.176 INFO 9 --- [ocp-schedules-2,2842fa46f3af6481,3cd458fbb42ff5c1] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:57:29.178 INFO 9 --- [ocp-schedules-2,2842fa46f3af6481,3cd458fbb42ff5c1] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:57:29.938 INFO 9 --- [ocp-schedules-28,117c1df055221d3e,8c1a0ac14509843a] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:57:29.941 INFO 9 --- [ocp-schedules-8,91467435d5405f4c,dddfc4cc805bf678] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:57:29.941 INFO 9 --- [ocp-schedules-18,836487a7c1fc378c,53db708879971040] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:57:29.942 INFO 9 --- [ocp-schedules-12,b1653d52aa565d58,9580f522100ff420] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:57:29.942 INFO 9 --- [ocp-schedules-8,91467435d5405f4c,dddfc4cc805bf678] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:29.943 INFO 9 --- [ocp-schedules-18,836487a7c1fc378c,53db708879971040] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:29.943 INFO 9 --- [ocp-schedules-12,b1653d52aa565d58,9580f522100ff420] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:29.943 INFO 9 --- [ocp-schedules-12,b1653d52aa565d58,9580f522100ff420] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:57:29.944 INFO 9 --- [ocp-schedules-4,3853a160446ba116,6d812e5ac9937b7f] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:57:29.945 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:57:29.945 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:57:29.945 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:57:29.945 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:57:29.945 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:57:29.945 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:57:29.945 INFO 9 --- [ocp-schedules-26,4ddba6be2233c30f,2089aaf4d6d764ed] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:57:29.945 INFO 9 --- [ocp-schedules-23,63fd295a2252df06,a4dada3e207b5a16] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:57:29.945 INFO 9 --- [host-check-clockdiff1,63fd295a2252df06,5443e9b934ff50d3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:57:29.945 INFO 9 --- [host-check-agent-status1,4ddba6be2233c30f,6553c763dc1c1d6b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:57:29.945 INFO 9 --- [host-check-agent-status2,4ddba6be2233c30f,f45a890539421c1b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:57:29.946 INFO 9 --- [host-check-clockdiff2,63fd295a2252df06,378543f4003fab66] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:57:29.946 INFO 9 --- [host-check-agent-status3,4ddba6be2233c30f,5ad2e366905b9702] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:57:29.946 INFO 9 --- [host-check-clockdiff3,63fd295a2252df06,810adef0b4dd31cd] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:57:29.946 INFO 9 --- [host-check-agent-status4,4ddba6be2233c30f,c27089ff2a48eddf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:57:29.946 INFO 9 --- [host-check-clockdiff4,63fd295a2252df06,c511156396a963c6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:57:29.946 INFO 9 --- [host-check-agent-status5,4ddba6be2233c30f,1ac07f09a0c32af1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:57:29.946 INFO 9 --- [host-check-clockdiff5,63fd295a2252df06,d1fec033d837e34c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:57:29.946 INFO 9 --- [host-check-agent-status6,4ddba6be2233c30f,f39666df5da55c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:57:29.946 INFO 9 --- [host-check-clockdiff6,63fd295a2252df06,e7e768d747f4fdf4] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:57:29.950 INFO 9 --- [host-check-clockdiff2,63fd295a2252df06,378543f4003fab66] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002249 -2 -2 , error= 2025-09-16 13:57:29.952 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:57:29.952 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:57:29.952 INFO 9 --- [ocp-schedules-16,208a11b1e4c94046,0739fb9377e2674c] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:57:29.953 INFO 9 --- [host-check-agent-status1,4ddba6be2233c30f,6553c763dc1c1d6b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:57:29.953 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:57:29.953 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:57:29.953 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:29.954 INFO 9 --- [host-check-agent-status5,4ddba6be2233c30f,1ac07f09a0c32af1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:57:29.954 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:29.954 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:57:29.954 INFO 9 --- [host-check-agent-status3,4ddba6be2233c30f,5ad2e366905b9702] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:57:29.954 INFO 9 --- [host-check-agent-status6,4ddba6be2233c30f,f39666df5da55c8f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:29.954 INFO 9 --- [host-check-clockdiff3,63fd295a2252df06,810adef0b4dd31cd] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002249 -1 -1 , error= 2025-09-16 13:57:29.954 INFO 9 --- [host-check-clockdiff5,63fd295a2252df06,d1fec033d837e34c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002249 -1 -1 , error= 2025-09-16 13:57:29.955 INFO 9 --- [host-check-agent-status2,4ddba6be2233c30f,f45a890539421c1b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:57:29.955 INFO 9 --- [host-check-agent-status4,4ddba6be2233c30f,c27089ff2a48eddf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:57:29.955 INFO 9 --- [host-check-agent-status1,4ddba6be2233c30f,6553c763dc1c1d6b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:57:29.955 INFO 9 --- [host-check-clockdiff4,63fd295a2252df06,c511156396a963c6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002249 -1 -1 , error= 2025-09-16 13:57:29.955 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:57:29.955 INFO 9 --- [host-check-clockdiff1,63fd295a2252df06,5443e9b934ff50d3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002249 -1 -1 , error= 2025-09-16 13:57:29.955 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:57:29.956 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:29.956 INFO 9 --- [host-check-agent-status6,4ddba6be2233c30f,f39666df5da55c8f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:29.956 INFO 9 --- [host-check-agent-status5,4ddba6be2233c30f,1ac07f09a0c32af1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:57:29.956 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:57:29.956 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:57:29.956 INFO 9 --- [host-check-agent-status4,4ddba6be2233c30f,c27089ff2a48eddf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:57:29.956 INFO 9 --- [host-check-agent-status3,4ddba6be2233c30f,5ad2e366905b9702] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:57:29.957 INFO 9 --- [host-check-agent-status2,4ddba6be2233c30f,f45a890539421c1b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:29.962 INFO 9 --- [ocp-schedules-10,12e9c9081571dcd6,caa64ba0943feb1e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:57:29.963 INFO 9 --- [ocp-schedules-27,24f097da0ddcb5b1,48e1fa760c260085] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:57:29.967 INFO 9 --- [ocp-schedules-10,12e9c9081571dcd6,caa64ba0943feb1e] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:57:29.969 INFO 9 --- [ocp-schedules-27,24f097da0ddcb5b1,48e1fa760c260085] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:57:29.970 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-agent-status4,4ddba6be2233c30f,c27089ff2a48eddf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-agent-status5,4ddba6be2233c30f,1ac07f09a0c32af1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-agent-status1,4ddba6be2233c30f,6553c763dc1c1d6b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-agent-status3,4ddba6be2233c30f,5ad2e366905b9702] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:57:29.971 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:57:29.972 INFO 9 --- [host-check-agent-status6,4ddba6be2233c30f,f39666df5da55c8f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:57:29.972 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:57:29.971208976+08:00 2025-09-16 13:57:29.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:57:29.972+08:00 2025-09-16 13:57:29.973 INFO 9 --- [host-check-agent-status2,4ddba6be2233c30f,f45a890539421c1b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:57:29.971877113+08:00 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:57:29.971827563+08:00 2025-09-16 13:57:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:57:29.972620518+08:00 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:57:29.973+08:00 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:57:29.972770817+08:00 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:57:29.973+08:00 2025-09-16 13:57:29.973 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:57:29.972667800+08:00 2025-09-16 13:57:29.974 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:57:29.973+08:00 2025-09-16 13:57:29.974 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:57:29.973+08:00 2025-09-16 13:57:29.974 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:57:29.973+08:00 2025-09-16 13:57:29.975 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:57:29.972+08:00 and status AVAILABLE 2025-09-16 13:57:29.975 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:57:29.973+08:00 and status AVAILABLE 2025-09-16 13:57:29.975 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:57:29.973+08:00 and status AVAILABLE 2025-09-16 13:57:29.975 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:57:29.973+08:00 and status AVAILABLE 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status4,4ddba6be2233c30f,c27089ff2a48eddf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status5,4ddba6be2233c30f,1ac07f09a0c32af1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status5,4ddba6be2233c30f,1ac07f09a0c32af1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status4,4ddba6be2233c30f,c27089ff2a48eddf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status1,4ddba6be2233c30f,6553c763dc1c1d6b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status4,4ddba6be2233c30f,c27089ff2a48eddf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status1,4ddba6be2233c30f,6553c763dc1c1d6b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status5,4ddba6be2233c30f,1ac07f09a0c32af1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:57:29.975 INFO 9 --- [host-check-agent-status1,4ddba6be2233c30f,6553c763dc1c1d6b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:57:29.975 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:57:29.973+08:00 and status AVAILABLE 2025-09-16 13:57:29.976 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:57:29.973+08:00 and status AVAILABLE 2025-09-16 13:57:29.976 INFO 9 --- [host-check-agent-status3,4ddba6be2233c30f,5ad2e366905b9702] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:57:29.976 INFO 9 --- [host-check-agent-status3,4ddba6be2233c30f,5ad2e366905b9702] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:57:29.976 INFO 9 --- [host-check-agent-status3,4ddba6be2233c30f,5ad2e366905b9702] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:57:29.976 INFO 9 --- [host-check-agent-status6,4ddba6be2233c30f,f39666df5da55c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:57:29.976 INFO 9 --- [host-check-agent-status6,4ddba6be2233c30f,f39666df5da55c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:57:29.976 INFO 9 --- [host-check-agent-status6,4ddba6be2233c30f,f39666df5da55c8f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:57:29.977 INFO 9 --- [host-check-agent-status2,4ddba6be2233c30f,f45a890539421c1b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:57:29.977 INFO 9 --- [host-check-agent-status2,4ddba6be2233c30f,f45a890539421c1b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:57:29.977 INFO 9 --- [host-check-agent-status2,4ddba6be2233c30f,f45a890539421c1b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:57:29.977 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:57:29.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:57:29.978 INFO 9 --- [ocp-schedules-18,836487a7c1fc378c,53db708879971040] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:57:29.979 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:57:29.979 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:57:29.979 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:57:29.979 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:57:29.979 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:57:29.984 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:29.984 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:29.985 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:57:29.985 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:57:29.985 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:57:29.985 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:57:29.985 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:57:29.986 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:57:29.986 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:29.986 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:29.986 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:57:29.986 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:57:29.986 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:57:29.986 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:57:29.998 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:29.999 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:29.999 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:30.000 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:30.000 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:30.000 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:57:30.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:57:30.003022+08:00, lastProcessTime=2025-09-16T13:57:20.003530+08:00 2025-09-16 13:57:30.025 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:30.026 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:57:30.026 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:30.026 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:57:30.027 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:57:30.027 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:57:30.027 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:57:30.028 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:57:30.028 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:57:30.033 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:57:30.033 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:57:30.034 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:57:30.034 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:57:30.034 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:57:30.035 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:57:30.046 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:30.047 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:30.047 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:30.047 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:30.047 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:30.048 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:57:30.060 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:30.062 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:30.062 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:57:30.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:30.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:57:30.070 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:30.073 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:57:30.075 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:57:30.075 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:57:30.075 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:57:30.076 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:57:30.077 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:57:30.080 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:57:30.082 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:57:30.082 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:57:30.083 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:57:30.083 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:57:30.084 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:57:30.085 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.085 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:30.093 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:30.093 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:30.095 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:30.095 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:30.095 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:30.095 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:57:30.101 INFO 9 --- [prometheus-second-schedule-1,9ac2580bab64bbcd,16cad826a0785816] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:57:30.102 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.102 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:30.116 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.116 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:30.121 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:57:30.121 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:57:30.122 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:57:30.123 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:57:30.123 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:57:30.126 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:57:30.128 INFO 9 --- [host-check-host-status1,3853a160446ba116,0f4a05eaa595d605] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:57:30.128 INFO 9 --- [host-check-host-status3,3853a160446ba116,b38addfe99a47852] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:57:30.128 INFO 9 --- [host-check-host-status2,3853a160446ba116,b8badaea175f6f19] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:57:30.130 INFO 9 --- [host-check-host-status5,3853a160446ba116,f49bc1d280f5e279] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:57:30.130 INFO 9 --- [host-check-host-status4,3853a160446ba116,249221e2a82eda93] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:57:30.133 INFO 9 --- [host-check-host-status6,3853a160446ba116,edd06118e97d7932] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:57:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:30.137 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:57:30.003022+08:00 2025-09-16 13:57:30.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:30.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:30.175 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.175 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:30.186 INFO 9 --- [ocp-async-2,af2d6f36ae083c1a,597609840673c8cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:57:30.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:57:30.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.205 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:57:30.222 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:57:30.235 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:30.236 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:30.237 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:57:30.242 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:57:30.245 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:57:30.248 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:30.249 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:30.262 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:57:30.277 INFO 9 --- [ocp-schedules-3,715a0ad0e600e883,831d8f9d8ff576c2] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:57:30.278 INFO 9 --- [ocp-schedules-3,715a0ad0e600e883,831d8f9d8ff576c2] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:30.278 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:57:30.278 INFO 9 --- [ocp-schedules-3,715a0ad0e600e883,831d8f9d8ff576c2] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:57:30.323 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:57:30.337 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:30.338 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:30.339 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:57:30.354 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:57:30.354 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:57:30.354 INFO 9 --- [ocp-schedules-8,91467435d5405f4c,dddfc4cc805bf678] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:57:30.407 INFO 9 --- [ocp-schedules-25,f9dcd0188a49e987,fe7440915c52fcdb] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:57:30.565 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:30.565 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:30.595 INFO 9 --- [ocp-schedules-16,f824ecb38d7473d2,51c6467099d4581c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:57:30.597 INFO 9 --- [ocp-schedules-16,f824ecb38d7473d2,51c6467099d4581c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:57:30.597 INFO 9 --- [ocp-schedules-16,f824ecb38d7473d2,51c6467099d4581c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:57:30.803 WARN 9 --- [ocp-async-5,2af75b1343dd9e4e,754d9a9a3bbfd392] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:30.803 INFO 9 --- [ocp-async-9,94b28433c227e5c9,7e27224f0ec4ac12] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:30.858 INFO 9 --- [ocp-schedules-7,a13780b0d6adbde4,75464277f318765e] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:57:30.887 INFO 9 --- [host-check-clockdiff6,63fd295a2252df06,e7e768d747f4fdf4] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002250 -2 -2 , error= 2025-09-16 13:57:30.987 INFO 9 --- [ocp-schedules-2,5b43b76f56e5bb94,414dab9c693b309e] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:57:30.987 INFO 9 --- [ocp-schedules-2,5b43b76f56e5bb94,414dab9c693b309e] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:57:31.491 INFO 9 --- [ocp-schedules-21,082af5a24cf3e55a,919340a296b96a8b] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:57:31.491 INFO 9 --- [ocp-schedules-21,082af5a24cf3e55a,919340a296b96a8b] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002251 2025-09-16 13:57:31.491 INFO 9 --- [ocp-schedules-21,082af5a24cf3e55a,919340a296b96a8b] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:57:31.636 INFO 9 --- [prometheus-minute-schedule-1,113a4995643ad25f,bbf2c01bf79604a1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:31.639 INFO 9 --- [prometheus-minute-schedule-1,113a4995643ad25f,bbf2c01bf79604a1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:31.661 INFO 9 --- [ocp-schedules-3,5b3f7cfa12f78a64,0a3a6bee2bc6dd28] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:57:31.679 INFO 9 --- [ocp-schedules-13,6528549c6417460d,f52d3638c07d2ded] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:57:31.684 WARN 9 --- [scanner-1381772-1,6528549c6417460d,7a844dab4c2cab7a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:57:31.708 INFO 9 --- [ocp-schedules-25,bcb3c33e18855bc6,272ca73913d7f959] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:57:31.708 INFO 9 --- [ocp-schedules-25,bcb3c33e18855bc6,272ca73913d7f959] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 13:57:31.709 INFO 9 --- [ocp-schedules-25,bcb3c33e18855bc6,272ca73913d7f959] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:57:31.709 INFO 9 --- [ocp-schedules-25,bcb3c33e18855bc6,272ca73913d7f959] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:57:31.709 INFO 9 --- [ocp-schedules-25,bcb3c33e18855bc6,272ca73913d7f959] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:57:31.709 INFO 9 --- [ocp-schedules-25,bcb3c33e18855bc6,272ca73913d7f959] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:57:31.717 INFO 9 --- [ocp-schedules-12,a7b3085e2aa007cc,3e8dbc5f339ec7af] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:57:32.803 WARN 9 --- [ocp-async-2,b1d32f4e039b7531,14bb80bceec4a279] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:32.803 INFO 9 --- [ocp-async-10,bc570e463c050bed,0c1ef11263ea3232] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:33.467 INFO 9 --- [ocp-schedules-28,16e34ab90a7ac5d9,ac92c890a50904b4] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:57:33.566 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:33.566 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:33.602 INFO 9 --- [ocp-schedules-7,91ea97fb1d81c524,22458ca3e210963d] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:57:33.602+08:00, clusters=[1] 2025-09-16 13:57:33.603 INFO 9 --- [ocp-schedules-7,91ea97fb1d81c524,22458ca3e210963d] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:57:34.171 INFO 9 --- [ocp-schedules-23,8b64586eaff5e96c,d7b9b860ffc67a78] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:57:34.171 INFO 9 --- [ocp-schedules-23,8b64586eaff5e96c,d7b9b860ffc67a78] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:57:34.171 INFO 9 --- [ocp-schedules-23,8b64586eaff5e96c,d7b9b860ffc67a78] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:57:34.187 INFO 9 --- [ocp-schedules-23,8b64586eaff5e96c,d7b9b860ffc67a78] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:57:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:57:34.482 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,cd5d67d20762e440,224281af3a93956b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=cd5d67d20762e440, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:57:34.483 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,cd5d67d20762e440,224281af3a93956b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=cd5d67d20762e440, duration=1 ms] 2025-09-16 13:57:34.484 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,30a80c98da94b8d8,71168a1dc3ce0ca8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba, client=10.232.140.0, traceId=30a80c98da94b8d8, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,false,] 2025-09-16 13:57:34.485 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,30a80c98da94b8d8,71168a1dc3ce0ca8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=30a80c98da94b8d8, duration=1 ms] 2025-09-16 13:57:34.636 INFO 9 --- [prometheus-minute-schedule-1,4f1dd75c20890d1f,aba493a7948650d1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:34.639 INFO 9 --- [prometheus-minute-schedule-1,4f1dd75c20890d1f,aba493a7948650d1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:34.716 INFO 9 --- [ocp-schedules-18,0805cd1028cbd473,b0dca62692e04214] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:57:34.721 INFO 9 --- [ocp-schedules-18,0805cd1028cbd473,b0dca62692e04214] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:57:34.721 INFO 9 --- [ocp-schedules-18,0805cd1028cbd473,b0dca62692e04214] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:57:34.803 WARN 9 --- [ocp-async-3,cc0e66928872626f,d77bd9bbfe461f63] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:34.803 INFO 9 --- [ocp-async-1,03431a09cbc428f4,2ce533e18996cdad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:34.832 INFO 9 --- [ocp-schedules-16,f402616da07e2878,48b74c2603ae92d6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:57:35.702 INFO 9 --- [ocp-schedules-12,f9bc3259482aabce,20c4b4bd761ec84f] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:57:35.702+08:00, clusters=[1] 2025-09-16 13:57:35.706 INFO 9 --- [ocp-schedules-12,f9bc3259482aabce,20c4b4bd761ec84f] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 13:57:36.566 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:36.567 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:36.803 WARN 9 --- [ocp-async-8,3e57d641345142f9,99de40fe1e69296d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:36.803 INFO 9 --- [ocp-async-5,963136f238420626,29275071b427d8cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:37.636 INFO 9 --- [prometheus-minute-schedule-1,d52c4f0a80a17959,2e81c0b2515da632] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:37.639 INFO 9 --- [prometheus-minute-schedule-1,d52c4f0a80a17959,2e81c0b2515da632] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:37.908 INFO 9 --- [ocp-schedules-21,2f3eab250459bc32,a60b31c227a3ad65] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:57:37.909 INFO 9 --- [ocp-schedules-21,2f3eab250459bc32,a60b31c227a3ad65] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:37.929 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:37.930 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:57:37.943 INFO 9 --- [ocp-schedules-21,2f3eab250459bc32,a60b31c227a3ad65] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:57:38.803 WARN 9 --- [ocp-async-9,0dae4767c77ad3ad,b73475ea681cc0c0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:38.803 INFO 9 --- [ocp-async-2,41e728885d18ec84,71a28db6e90a0779] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:39.183 INFO 9 --- [ocp-schedules-18,4a4ce0f8c9ce1eec,62642e5bc75734a3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:57:39.185 INFO 9 --- [ocp-schedules-18,4a4ce0f8c9ce1eec,62642e5bc75734a3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:57:39.567 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:39.567 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:39.999 INFO 9 --- [ocp-schedules-10,ab5ebe2c22454c0e,8c63ca14f787187e] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:57:39.999 INFO 9 --- [ocp-schedules-10,ab5ebe2c22454c0e,8c63ca14f787187e] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:57:40.002 INFO 9 --- [ocp-schedules-5,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:57:40.003 INFO 9 --- [ocp-schedules-8,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:57:40.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:57:40.004550+08:00, lastProcessTime=2025-09-16T13:57:30.003022+08:00 2025-09-16 13:57:40.008 INFO 9 --- [ocp-schedules-30,d3a4d730eabce582,bb656a88643027ac] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:57:40.008 INFO 9 --- [ocp-schedules-30,d3a4d730eabce582,bb656a88643027ac] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:57:40.008 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:57:40.008 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:57:40.008 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:57:40.008 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:57:40.011 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:57:40.012 INFO 9 --- [ocp-schedules-30,d3a4d730eabce582,bb656a88643027ac] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:57:40.012 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:57:40.012 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:40.012 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:57:40.012 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:57:40.013 INFO 9 --- [ocp-schedules-30,d3a4d730eabce582,bb656a88643027ac] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:57:40.013 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:57:40.013 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:40.013 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:40.015 INFO 9 --- [Collect all tenants major compactions1,ab5ebe2c22454c0e,b451dab52dce3ffd] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:57:40.016 INFO 9 --- [Collect all tenants major compactions3,ab5ebe2c22454c0e,bdefbfc577f92248] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:57:40.016 INFO 9 --- [Collect all tenants major compactions2,ab5ebe2c22454c0e,1ba05d554116e446] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:57:40.026 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:57:40.027 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:57:40.027 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:57:40.028 INFO 9 --- [ocp-schedules-30,d3a4d730eabce582,bb656a88643027ac] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:57:40.028 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:57:40.029 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:57:40.031 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:57:40.032 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:57:40.034 INFO 9 --- [Collect all tenants major compactions2,ab5ebe2c22454c0e,1ba05d554116e446] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:40.034 INFO 9 --- [Collect all tenants major compactions1,ab5ebe2c22454c0e,b451dab52dce3ffd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:40.034 INFO 9 --- [Collect all tenants major compactions3,ab5ebe2c22454c0e,bdefbfc577f92248] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:40.035 INFO 9 --- [Collect all tenants major compactions1,ab5ebe2c22454c0e,b451dab52dce3ffd] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:57:40.035 INFO 9 --- [Collect all tenants major compactions2,ab5ebe2c22454c0e,1ba05d554116e446] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:57:40.035 INFO 9 --- [Collect all tenants major compactions3,ab5ebe2c22454c0e,bdefbfc577f92248] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:57:40.040 INFO 9 --- [Collect all tenants major compactions3,ab5ebe2c22454c0e,bdefbfc577f92248] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:57:40.040 INFO 9 --- [Collect all tenants major compactions2,ab5ebe2c22454c0e,1ba05d554116e446] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:57:40.040 INFO 9 --- [Collect all tenants major compactions1,ab5ebe2c22454c0e,b451dab52dce3ffd] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:57:40.041 INFO 9 --- [ocp-schedules-10,ab5ebe2c22454c0e,8c63ca14f787187e] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:57:40.046 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:57:40.047 INFO 9 --- [ocp-schedules-30,d3a4d730eabce582,bb656a88643027ac] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:57:40.129 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:57:40.004550+08:00 2025-09-16 13:57:40.186 INFO 9 --- [ocp-async-7,796e07c31b7d5245,9f211e35e7029bff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:57:40.636 INFO 9 --- [prometheus-minute-schedule-1,e0f529bce77183f9,850364e50b214fb8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:40.639 INFO 9 --- [prometheus-minute-schedule-1,e0f529bce77183f9,850364e50b214fb8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:40.803 WARN 9 --- [ocp-async-6,e781ea9874f85446,2c151eb220046804] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:40.803 INFO 9 --- [ocp-async-1,2ed668dadc9dc3b3,18ea9bc98fc3400f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:41.192 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:53:41, end=2025-09-16T13:55:41.19} 2025-09-16 13:57:41.197 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbit 2025-09-16 13:57:41.197 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:57:41.202 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:41, end=2025-09-16T13:55:41.19},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:57:41.202 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:57:41.202 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:57:41.211 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:57:41.213 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:41, end=2025-09-16T13:55:41.19},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:57:41.213 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:57:41.213 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:57:41.217 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:57:41.219 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 1 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:41, end=2025-09-16T13:55:41.19},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:57:41.226 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:57:41.226 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:57:41.286 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915861286000, endTimeUs=1758002141190000, obClusterId=1, clusterName=zhengqi, obTenantId=1002, sqlId=191933AE72586F2C171C875DF459B6FC, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=2, obTenantId=1002, tenantName=cos, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:57:41.286Z, endTime=2025-09-16T05:55:41.190Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=2, name=cos, obTenantId=1002, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, 2025-09-16 13:57:41.286 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915861286000, endTimeUs=1758002141190000, obClusterId=1, clusterName=zhengqi, obTenantId=1002, sqlId=E9E2014C8CE705871C555597A6A32456, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=2, obTenantId=1002, tenantName=cos, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:57:41.286Z, endTime=2025-09-16T05:55:41.190Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=2, name=cos, obTenantId=1002, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, 2025-09-16 13:57:41.292 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 0 2025-09-16 13:57:41.292 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:57:41.293 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 0 2025-09-16 13:57:41.293 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:57:41.307 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:57:41.307 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002141190000, obClusterId=1, clusterName=zhengqi, obTenantId=1002, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 13:57:41.307 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:57:41.307 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002141190000, obClusterId=1, clusterName=zhengqi, obTenantId=1002, obServerId=null, obDbId=201001, sqlId=191933AE72586F2C171C875DF459B6FC, sqlIdList=null, dynamicSql=false) 2025-09-16 13:57:41.313 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:57:41.313 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:57:41.314 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:57:41.314 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:57:41.327 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:57:41.327 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002141190000, obClusterId=1, clusterName=zhengqi, obTenantId=1002, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 13:57:41.328 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:57:41.328 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002141190000, obClusterId=1, clusterName=zhengqi, obTenantId=1002, obServerId=null, obDbId=201001, sqlId=191933AE72586F2C171C875DF459B6FC, sqlIdList=null, dynamicSql=false) 2025-09-16 13:57:41.333 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records,use plan union hash 2025-09-16 13:57:41.333 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 0 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:57:41.286, end=2025-09-16T13:55:41.19}, clusterId=1, tenantId=2, sqlId=E9E2014C8CE705871C555597A6A32456, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:57:41.334 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records,use plan union hash 2025-09-16 13:57:41.334 INFO 9 --- [plan_change_detector7,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 0 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:57:41.286, end=2025-09-16T13:55:41.19}, clusterId=1, tenantId=2, sqlId=191933AE72586F2C171C875DF459B6FC, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:57:41.334 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:57:41.706 INFO 9 --- [ocp-schedules-10,a7b5d605b8ecc662,fca56bed8f117edc] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:57:41.711 WARN 9 --- [scanner-1381899-1,a7b5d605b8ecc662,937733fc39be4fda] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:57:41.720 INFO 9 --- [alarm-detect-19,a7b5d605b8ecc662,6838eed8617f8e7c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:57:41.723 INFO 9 --- [alarm-detect-1,a7b5d605b8ecc662,54c6c8cee917a8aa] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:57:41.723 INFO 9 --- [alarm-detect-10,a7b5d605b8ecc662,650731ec7b0cf4db] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:57:41.736 INFO 9 --- [alarm-detect-3,a7b5d605b8ecc662,4a23a7429029abd9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:57:42.507 INFO 9 --- [ocp-schedules-30,eb8ade5d7e0e89c3,3c96aa61af2b56a8] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:57:42.507 INFO 9 --- [ocp-schedules-30,eb8ade5d7e0e89c3,3c96aa61af2b56a8] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:57:42.524 INFO 9 --- [ocp-schedules-30,eb8ade5d7e0e89c3,3c96aa61af2b56a8] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:57:42.540 INFO 9 --- [ocp-schedules-30,eb8ade5d7e0e89c3,3c96aa61af2b56a8] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:42.541 INFO 9 --- [ocp-schedules-30,eb8ade5d7e0e89c3,3c96aa61af2b56a8] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:57:42.567 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:42.568 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:42.803 WARN 9 --- [ocp-async-7,8952da5f5c6f3df1,f01e83b05e0c3ec0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:42.803 INFO 9 --- [ocp-async-5,78a1fbb82327a3e5,191894907150c7f9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:43.636 INFO 9 --- [prometheus-minute-schedule-1,c54a4cdf39d16ddb,8f7f842057b1506a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:43.640 INFO 9 --- [prometheus-minute-schedule-1,c54a4cdf39d16ddb,8f7f842057b1506a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:44.803 WARN 9 --- [ocp-async-9,b1edfabc1c033059,2949593022361065] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:44.803 INFO 9 --- [ocp-async-2,0e9d741a9f92185f,5cb26b07a219c6de] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:44.835 INFO 9 --- [ocp-schedules-8,0160c33aaca684a9,73ae3975798dce97] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:57:45.568 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:45.569 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:45.761 INFO 9 --- [ocp-schedules-30,dc26830852163dea,1d96d6b989505742] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:57:45.763 INFO 9 --- [ocp-schedules-30,dc26830852163dea,1d96d6b989505742] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:45.809 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:57:45.809 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.812 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:57:45.838 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.839 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:57:45.861 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.862 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:57:45.882 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.883 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:57:45.887 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.888 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:57:45.909 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.909 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:57:45.933 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.933 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:57:45.938 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.938 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:57:45.962 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.962 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:57:45.984 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:45.985 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:57:46.002 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.002 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:57:46.003 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.004 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:57:46.005 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.005 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:57:46.006 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.007 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:57:46.008 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.008 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:57:46.009 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.010 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:57:46.026 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.026 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:57:46.027 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.028 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:57:46.029 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.029 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:57:46.045 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:57:46.046 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:57:46.069 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:57:46.070 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:46.070 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:57:46.103 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:57:46.103 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:57:46.103 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:57:46.103 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:57:46.103 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:57:46.103 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:57:46.105 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:57:46.105 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:57:46.105 INFO 9 --- [ocp-schedules-30,dc26830852163dea,1d96d6b989505742] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:57:46.636 INFO 9 --- [prometheus-minute-schedule-1,f3a26a7fe0288b8c,29bb0b2bff9918fb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:46.640 INFO 9 --- [prometheus-minute-schedule-1,f3a26a7fe0288b8c,29bb0b2bff9918fb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:46.804 WARN 9 --- [ocp-async-3,6944d06786d3bcf5,5d5d96428b5c6d19] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:46.804 INFO 9 --- [ocp-async-6,2814a9880cb12998,b5beea5736ce1e86] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:57:46,990 |-INFO in ReconfigureOnChangeTask(born:1758002146990) - Empty watch file list. Disabling 2025-09-16 13:57:48.569 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:48.569 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:48.804 WARN 9 --- [ocp-async-1,290d82e476b32d61,3ceb924872ae793f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:48.804 INFO 9 --- [ocp-async-7,d28f5f0bf45c7647,c685dfdc8662aa08] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:49.190 INFO 9 --- [ocp-schedules-12,f93519e46523ebfa,14c1474d59c542b2] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:57:49.192 INFO 9 --- [ocp-schedules-12,f93519e46523ebfa,14c1474d59c542b2] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:57:49.636 INFO 9 --- [prometheus-minute-schedule-1,d6cdab2884528b5c,6e171f37432e38e9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:49.639 INFO 9 --- [prometheus-minute-schedule-1,d6cdab2884528b5c,6e171f37432e38e9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:57:50.003307+08:00, lastProcessTime=2025-09-16T13:57:40.004550+08:00 2025-09-16 13:57:50.123 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:57:50.003307+08:00 2025-09-16 13:57:50.186 INFO 9 --- [ocp-async-2,d14a0b3fecc03c4a,2527b97247e8f1e5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:57:50.804 WARN 9 --- [ocp-async-9,2686034d692c93a0,01e21d2fb1f780e4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:50.804 INFO 9 --- [ocp-async-10,cafc67a468ecbbd0,72c6b9834bd827df] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:51.570 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:51.570 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:51.738 INFO 9 --- [ocp-schedules-2,9f95a700ccd4b5ba,9e11aa86131c4350] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:57:51.743 WARN 9 --- [scanner-1382060-1,9f95a700ccd4b5ba,b612fbc2804510ca] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:57:52.636 INFO 9 --- [prometheus-minute-schedule-1,0b0440dccc7b80c8,92001e61ad428580] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:52.640 INFO 9 --- [prometheus-minute-schedule-1,0b0440dccc7b80c8,92001e61ad428580] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:52.804 WARN 9 --- [ocp-async-2,4aec82c6880e8c4a,86788d0adc3fd7dc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:52.804 INFO 9 --- [ocp-async-8,23bd92b130816b2c,51b2e6f4309f48c7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:54.570 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:54.571 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:54.723 INFO 9 --- [ocp-schedules-30,8d6b59051dc8646b,00251a1c9ab3b98b] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:57:54.727 INFO 9 --- [ocp-schedules-30,8d6b59051dc8646b,00251a1c9ab3b98b] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:57:54.727 INFO 9 --- [ocp-schedules-30,8d6b59051dc8646b,00251a1c9ab3b98b] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:57:54.804 WARN 9 --- [ocp-async-1,45ea8fc50a474541,52e3911b0b58b24d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:54.804 INFO 9 --- [ocp-async-4,840f7dad42a6d5e5,20efee92aed32d3f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:54.840 INFO 9 --- [ocp-schedules-17,8d90656af0f83a12,17049b30ee077148] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:57:55.636 INFO 9 --- [prometheus-minute-schedule-1,3cbe689946d6d605,ecbf8af90b70e138] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:55.640 INFO 9 --- [prometheus-minute-schedule-1,3cbe689946d6d605,ecbf8af90b70e138] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:56.804 WARN 9 --- [ocp-async-5,b7b7b6c9fae575af,476e59b3d402273a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:56.804 INFO 9 --- [ocp-async-9,3355e480fa62f665,7ea36a6e76dbd6c0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:57.571 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:57:57.571 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:57:58.636 INFO 9 --- [prometheus-minute-schedule-1,51b72104c2fba0ec,919de02e09259623] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002280, interval=60 2025-09-16 13:57:58.639 INFO 9 --- [prometheus-minute-schedule-1,51b72104c2fba0ec,919de02e09259623] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:57:58.804 WARN 9 --- [ocp-async-10,4a3d32c1cc56777a,11afcea0492ea792] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:57:58.804 INFO 9 --- [ocp-async-2,0b944fd24e61a5a9,97c8d4fa1d5352f0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:57:59.197 INFO 9 --- [ocp-schedules-13,f7a3462fa2c676c6,7c94d6960bfda8bd] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:57:59.199 INFO 9 --- [ocp-schedules-13,f7a3462fa2c676c6,7c94d6960bfda8bd] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:57:59.938 INFO 9 --- [ocp-schedules-2,64bb99138a0f3f67,311944e098a2fba6] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:57:59.941 INFO 9 --- [ocp-schedules-15,dcc9f91706bad425,f538876f5c07f1b9] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:57:59.941 INFO 9 --- [ocp-schedules-28,23a73e19228fd41b,cfb8026398b54347] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:57:59.942 INFO 9 --- [ocp-schedules-9,4bdebd6125118d65,3c1e5eb1b98f4fb1] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:57:59.942 INFO 9 --- [ocp-schedules-15,dcc9f91706bad425,f538876f5c07f1b9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:59.942 INFO 9 --- [ocp-schedules-28,23a73e19228fd41b,cfb8026398b54347] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:59.944 INFO 9 --- [ocp-schedules-9,4bdebd6125118d65,3c1e5eb1b98f4fb1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:57:59.944 INFO 9 --- [ocp-schedules-9,4bdebd6125118d65,3c1e5eb1b98f4fb1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:57:59.944 INFO 9 --- [ocp-schedules-4,11abd9c24eee2f3c,9fb14b0a5a9d515d] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:57:59.944 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [ocp-schedules-26,a00ed03075a90e48,721488998525f7f5] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:57:59.945 INFO 9 --- [ocp-schedules-18,c225e53b6c3d396a,9f4846500d0d1354] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:57:59.945 INFO 9 --- [host-check-agent-status1,a00ed03075a90e48,d0bdb2e6bdcb93cf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-agent-status2,a00ed03075a90e48,476ffb6487e39eb0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-agent-status3,a00ed03075a90e48,01b89c2d12fc9cc8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-clockdiff1,c225e53b6c3d396a,548f445856d17446] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:57:59.945 INFO 9 --- [host-check-agent-status4,a00ed03075a90e48,d5b73697b0a5842b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:57:59.945 INFO 9 --- [host-check-agent-status5,a00ed03075a90e48,edc534e3c27e6629] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:57:59.946 INFO 9 --- [host-check-clockdiff2,c225e53b6c3d396a,9974a114a8986832] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:57:59.946 INFO 9 --- [host-check-agent-status6,a00ed03075a90e48,ba08be3568210f75] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:57:59.946 INFO 9 --- [host-check-clockdiff3,c225e53b6c3d396a,4f1f37cb2ffaa4e0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:57:59.946 INFO 9 --- [host-check-clockdiff4,c225e53b6c3d396a,285014454eef9800] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:57:59.946 INFO 9 --- [host-check-clockdiff5,c225e53b6c3d396a,f94acb1c21526a80] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:57:59.946 INFO 9 --- [host-check-clockdiff6,c225e53b6c3d396a,954a4bb6ba1086ea] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:57:59.953 INFO 9 --- [host-check-clockdiff4,c225e53b6c3d396a,285014454eef9800] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002279 -1 -1 , error= 2025-09-16 13:57:59.954 INFO 9 --- [ocp-schedules-20,685c9961d4224712,f20d834368a8b0b5] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:57:59.954 INFO 9 --- [host-check-agent-status5,a00ed03075a90e48,edc534e3c27e6629] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:57:59.954 INFO 9 --- [host-check-clockdiff2,c225e53b6c3d396a,9974a114a8986832] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002279 -1 -1 , error= 2025-09-16 13:57:59.954 INFO 9 --- [host-check-clockdiff6,c225e53b6c3d396a,954a4bb6ba1086ea] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002279 -2 -2 , error= 2025-09-16 13:57:59.954 INFO 9 --- [host-check-agent-status2,a00ed03075a90e48,476ffb6487e39eb0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:57:59.954 INFO 9 --- [host-check-clockdiff1,c225e53b6c3d396a,548f445856d17446] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002279 -1 -1 , error= 2025-09-16 13:57:59.954 INFO 9 --- [host-check-agent-status3,a00ed03075a90e48,01b89c2d12fc9cc8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:57:59.955 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:57:59.955 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:57:59.955 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:57:59.955 INFO 9 --- [host-check-agent-status1,a00ed03075a90e48,d0bdb2e6bdcb93cf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:57:59.955 INFO 9 --- [host-check-clockdiff5,c225e53b6c3d396a,f94acb1c21526a80] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002279 -1 -1 , error= 2025-09-16 13:57:59.956 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:57:59.957 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:57:59.957 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:59.958 INFO 9 --- [host-check-clockdiff3,c225e53b6c3d396a,4f1f37cb2ffaa4e0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002279 -1 -1 , error= 2025-09-16 13:57:59.958 INFO 9 --- [host-check-agent-status4,a00ed03075a90e48,d5b73697b0a5842b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:57:59.958 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:57:59.958 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:59.959 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:57:59.959 INFO 9 --- [host-check-agent-status6,a00ed03075a90e48,ba08be3568210f75] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:59.959 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:57:59.959 INFO 9 --- [host-check-agent-status5,a00ed03075a90e48,edc534e3c27e6629] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:57:59.959 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:59.959 INFO 9 --- [host-check-agent-status3,a00ed03075a90e48,01b89c2d12fc9cc8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:57:59.959 INFO 9 --- [host-check-agent-status2,a00ed03075a90e48,476ffb6487e39eb0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:59.959 INFO 9 --- [host-check-agent-status1,a00ed03075a90e48,d0bdb2e6bdcb93cf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:57:59.959 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:57:59.960 INFO 9 --- [host-check-agent-status4,a00ed03075a90e48,d5b73697b0a5842b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:57:59.960 INFO 9 --- [host-check-agent-status6,a00ed03075a90e48,ba08be3568210f75] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:59.973 INFO 9 --- [host-check-agent-status5,a00ed03075a90e48,edc534e3c27e6629] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:57:59.973 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:57:59.973 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:57:59.973 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:57:59.973 INFO 9 --- [host-check-agent-status6,a00ed03075a90e48,ba08be3568210f75] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:57:59.974 INFO 9 --- [host-check-agent-status1,a00ed03075a90e48,d0bdb2e6bdcb93cf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:57:59.974 INFO 9 --- [host-check-agent-status3,a00ed03075a90e48,01b89c2d12fc9cc8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:57:59.975 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:57:59.973472106+08:00 2025-09-16 13:57:59.975 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:57:59.973867174+08:00 2025-09-16 13:57:59.975 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:57:59.974418135+08:00 2025-09-16 13:57:59.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:59.975 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:57:59.975+08:00 2025-09-16 13:57:59.975 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:57:59.975 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:57:59.975+08:00 2025-09-16 13:57:59.975 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:57:59.975+08:00 2025-09-16 13:57:59.976 INFO 9 --- [host-check-agent-status2,a00ed03075a90e48,476ffb6487e39eb0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:57:59.976 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:57:59.976 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:57:59.976 INFO 9 --- [host-check-agent-status4,a00ed03075a90e48,d5b73697b0a5842b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:57:59.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:57:59.976 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:57:59.975105197+08:00 2025-09-16 13:57:59.977 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:57:59.976+08:00 2025-09-16 13:57:59.977 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:57:59.975+08:00 and status AVAILABLE 2025-09-16 13:57:59.977 INFO 9 --- [host-check-agent-status3,a00ed03075a90e48,01b89c2d12fc9cc8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:57:59.977 INFO 9 --- [host-check-agent-status3,a00ed03075a90e48,01b89c2d12fc9cc8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:57:59.977 INFO 9 --- [host-check-agent-status3,a00ed03075a90e48,01b89c2d12fc9cc8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:57:59.977 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:57:59.975+08:00 and status AVAILABLE 2025-09-16 13:57:59.977 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:57:59.975+08:00 and status AVAILABLE 2025-09-16 13:57:59.977 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:57:59.976622203+08:00 2025-09-16 13:57:59.977 INFO 9 --- [host-check-agent-status5,a00ed03075a90e48,edc534e3c27e6629] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:57:59.977 INFO 9 --- [host-check-agent-status5,a00ed03075a90e48,edc534e3c27e6629] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:57:59.977 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:57:59.976690157+08:00 2025-09-16 13:57:59.977 INFO 9 --- [host-check-agent-status5,a00ed03075a90e48,edc534e3c27e6629] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:57:59.978 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:57:59.977+08:00 2025-09-16 13:57:59.978 INFO 9 --- [host-check-agent-status1,a00ed03075a90e48,d0bdb2e6bdcb93cf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:57:59.978 INFO 9 --- [host-check-agent-status1,a00ed03075a90e48,d0bdb2e6bdcb93cf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:57:59.978 INFO 9 --- [host-check-agent-status1,a00ed03075a90e48,d0bdb2e6bdcb93cf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:57:59.978 INFO 9 --- [host-check-agent-status6,a00ed03075a90e48,ba08be3568210f75] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:57:59.978 INFO 9 --- [host-check-agent-status6,a00ed03075a90e48,ba08be3568210f75] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:57:59.978 INFO 9 --- [host-check-agent-status6,a00ed03075a90e48,ba08be3568210f75] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:57:59.978 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:57:59.977+08:00 2025-09-16 13:57:59.978 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:57:59.976+08:00 and status AVAILABLE 2025-09-16 13:57:59.979 INFO 9 --- [host-check-agent-status2,a00ed03075a90e48,476ffb6487e39eb0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:57:59.979 INFO 9 --- [host-check-agent-status2,a00ed03075a90e48,476ffb6487e39eb0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:57:59.979 INFO 9 --- [host-check-agent-status2,a00ed03075a90e48,476ffb6487e39eb0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:57:59.979 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:57:59.977+08:00 and status AVAILABLE 2025-09-16 13:57:59.979 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:57:59.977+08:00 and status AVAILABLE 2025-09-16 13:57:59.980 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:57:59.980 INFO 9 --- [host-check-agent-status4,a00ed03075a90e48,d5b73697b0a5842b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:57:59.980 INFO 9 --- [host-check-agent-status4,a00ed03075a90e48,d5b73697b0a5842b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:57:59.980 INFO 9 --- [host-check-agent-status4,a00ed03075a90e48,d5b73697b0a5842b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:57:59.980 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:57:59.980 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:57:59.980 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:57:59.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:57:59.981 INFO 9 --- [ocp-schedules-28,23a73e19228fd41b,cfb8026398b54347] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:57:59.982 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:57:59.982 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:57:59.986 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:57:59.986 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:57:59.986 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:57:59.986 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:57:59.987 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:57:59.987 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:57:59.987 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:57:59.987 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:57:59.988 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:57:59.988 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:57:59.989 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:57:59.989 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:57:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:57:59.992 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:58:00.000 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:00.001 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:00.001 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:00.002 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:00.003 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:00.003 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:58:00.003776+08:00, lastProcessTime=2025-09-16T13:57:50.003307+08:00 2025-09-16 13:58:00.028 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:58:00.028 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:58:00.029 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:58:00.030 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:58:00.030 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:58:00.030 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:58:00.032 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:00.033 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:00.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:58:00.035 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:58:00.036 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:58:00.036 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:58:00.037 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:58:00.037 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:58:00.037 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:58:00.047 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:00.049 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:00.049 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:00.049 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:00.049 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:00.049 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:00.068 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:00.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:00.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:58:00.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:00.075 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:58:00.076 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:58:00.076 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:58:00.077 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:58:00.077 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:58:00.078 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:58:00.078 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:58:00.078 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:00.082 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:58:00.083 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:58:00.084 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:58:00.084 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:58:00.084 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:58:00.084 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:58:00.093 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.093 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:00.095 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:00.095 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:00.096 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:00.096 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:00.097 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:00.098 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:00.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:00.123 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:58:00.123 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:58:00.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.124 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:00.124 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:58:00.125 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:58:00.129 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:58:00.129 INFO 9 --- [host-check-host-status3,11abd9c24eee2f3c,2b6ddb2fcd964762] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:58:00.132 INFO 9 --- [host-check-host-status5,11abd9c24eee2f3c,3e11622af4b30c24] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:58:00.132 INFO 9 --- [host-check-host-status4,11abd9c24eee2f3c,6f5027cd3e03b71f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:58:00.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:58:00.003776+08:00 2025-09-16 13:58:00.132 INFO 9 --- [host-check-host-status2,11abd9c24eee2f3c,ac8e2b6bcc76e4e9] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:58:00.133 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:58:00.136 INFO 9 --- [host-check-host-status1,11abd9c24eee2f3c,436af71d6fcfefe8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:58:00.140 INFO 9 --- [host-check-host-status6,11abd9c24eee2f3c,6b0864cd258cf78a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:58:00.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:00.154 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.154 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:00.170 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.170 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:00.183 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.183 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:00.186 INFO 9 --- [ocp-async-4,390eb9bdd310381b,7d825e6b14f99cb8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:58:00.199 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.199 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:00.213 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.213 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:00.228 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:00.243 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:00.244 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:00.245 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:00.250 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:58:00.253 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:58:00.256 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:00.256 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:00.270 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:58:00.331 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:58:00.344 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:00.346 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:00.347 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:58:00.362 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:58:00.362 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:58:00.362 INFO 9 --- [ocp-schedules-15,dcc9f91706bad425,f538876f5c07f1b9] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:58:00.572 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:00.572 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:00.804 WARN 9 --- [ocp-async-8,fa0d0403163a7cf0,bf8f193db6eda6c3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:00.804 INFO 9 --- [ocp-async-1,b775395868db3aab,5b812ddfc3e227b6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:00.861 INFO 9 --- [ocp-schedules-9,a1a143c196f21f7f,2bf5ee5802a5056d] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:58:01.636 INFO 9 --- [prometheus-minute-schedule-1,5e199e3b45380ef5,b069e26e876ceb12] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:01.639 INFO 9 --- [prometheus-minute-schedule-1,5e199e3b45380ef5,b069e26e876ceb12] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:01.764 INFO 9 --- [ocp-schedules-1,39b72fe00d3830cc,95472a90c4825358] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:58:01.770 WARN 9 --- [scanner-1382190-1,39b72fe00d3830cc,479eb11e53dba1c1] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:58:01.780 INFO 9 --- [alarm-detect-17,39b72fe00d3830cc,78b9920b973d7a84] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:58:01.782 INFO 9 --- [alarm-detect-12,39b72fe00d3830cc,7ef1cc88b7490f0c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:58:01.783 INFO 9 --- [alarm-detect-10,39b72fe00d3830cc,783802d0e9055257] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:58:01.795 INFO 9 --- [alarm-detect-11,39b72fe00d3830cc,9f2de09fdc642539] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:58:02.804 WARN 9 --- [ocp-async-1,9f321464a8ee5b1a,ac3f4ac1aacd3573] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:02.805 INFO 9 --- [ocp-async-5,a93887af584e7ce5,31d02b7b2ea9b5d2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:03.572 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:03.573 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:04.636 INFO 9 --- [prometheus-minute-schedule-1,ce7827dbecba0c24,02004b5913603e75] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:04.639 INFO 9 --- [prometheus-minute-schedule-1,ce7827dbecba0c24,02004b5913603e75] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:04.805 WARN 9 --- [ocp-async-5,80d8c050b615ca9d,e8221bf887985c45] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:04.805 INFO 9 --- [ocp-async-10,67a3e69995aa1bc1,dc6b6330433c6cdc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:04.843 INFO 9 --- [ocp-schedules-29,647d93ccca23f006,ab1cfa1297796dbd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:58:06.573 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:06.574 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:06.805 WARN 9 --- [ocp-async-10,84de086158d813bb,964bc19c7327f441] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:06.805 INFO 9 --- [ocp-async-8,8a2e5d5d22cfb9fd,e04502820721114a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:07.636 INFO 9 --- [prometheus-minute-schedule-1,bac2dfb3947cc49f,9019d2541b9367fc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:07.639 INFO 9 --- [prometheus-minute-schedule-1,bac2dfb3947cc49f,9019d2541b9367fc] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:08.805 WARN 9 --- [ocp-async-8,759448b75e02fc28,f5370d63e84092ac] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:08.805 INFO 9 --- [ocp-async-1,d2a5413ffadeb507,7bed9ee4f39b3cbc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:09.204 INFO 9 --- [ocp-schedules-2,ee2aefb237b60ae4,4b2bb6f51d829e74] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:58:09.206 INFO 9 --- [ocp-schedules-2,ee2aefb237b60ae4,4b2bb6f51d829e74] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:58:09.574 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:09.574 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:10.002 INFO 9 --- [ocp-schedules-29,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:58:10.003 INFO 9 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:58:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:58:10.003207+08:00, lastProcessTime=2025-09-16T13:58:00.003776+08:00 2025-09-16 13:58:10.115 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:58:10.003207+08:00 2025-09-16 13:58:10.186 INFO 9 --- [ocp-async-10,3564b427a8f165b4,198ffe4b335de5f8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:58:10.296 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:58:10.636 INFO 9 --- [prometheus-minute-schedule-1,58adad892374817e,3ebc2b3bcd7142bb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:10.639 INFO 9 --- [prometheus-minute-schedule-1,58adad892374817e,3ebc2b3bcd7142bb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:10.805 INFO 9 --- [ocp-async-5,dfad01c9d7fbb646,50bc50f02e7187c3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:10.805 WARN 9 --- [ocp-async-2,83317c1c9348869d,3d0ef33b59a8199c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:11.752 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002220, nodeCount=460, affectRows=460 2025-09-16 13:58:11.798 INFO 9 --- [ocp-schedules-29,c6407f8d96f3bf20,56b81ab2a7bad4e5] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:58:11.802 WARN 9 --- [scanner-1383233-1,c6407f8d96f3bf20,c3a86ef235d2eec3] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:58:12.574 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:12.575 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:12.805 WARN 9 --- [ocp-async-10,692eeea57f893ecb,5b654ffe2a4281c3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:12.805 INFO 9 --- [ocp-async-4,314f52f969103b01,17d1c1f2f721a2c6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:13.636 INFO 9 --- [prometheus-minute-schedule-1,72d0cd00a683e752,a3b884b1ecace37c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:13.639 INFO 9 --- [prometheus-minute-schedule-1,72d0cd00a683e752,a3b884b1ecace37c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:14.463 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002220, nodeCount=1000, affectRows=1000 2025-09-16 13:58:14.466 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002220, nodeCount=1000, validCount=996 2025-09-16 13:58:14.492 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002220, nodeCount=1000, affectRows=1000 2025-09-16 13:58:14.494 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002220, nodeCount=1000, validCount=998 2025-09-16 13:58:14.506 ERROR 9 --- [metric-archive-second-1,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952599621632-1758002160' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952599621632-1758002160' for key 'PRIMARY' 2025-09-16 13:58:14.537 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002220, nodeCount=853, affectRows=853 2025-09-16 13:58:14.539 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002220, nodeCount=853, validCount=852 2025-09-16 13:58:14.729 INFO 9 --- [ocp-schedules-25,be6a43693b12bb9c,0e0409169e285484] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:58:14.732 INFO 9 --- [ocp-schedules-25,be6a43693b12bb9c,0e0409169e285484] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:58:14.732 INFO 9 --- [ocp-schedules-25,be6a43693b12bb9c,0e0409169e285484] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:58:14.805 WARN 9 --- [ocp-async-8,6d6071646c2dc0fa,a97550254edcb416] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:14.805 INFO 9 --- [ocp-async-9,b984ba862f8c1b80,4b646ac771219488] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:14.846 INFO 9 --- [ocp-schedules-21,647cc162981fac5d,0a33f983a298a69e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:58:15.575 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:15.576 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:15.751 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002220, nodeCount=1000, affectRows=1000 2025-09-16 13:58:15.754 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002220, nodeCount=991, validCount=944 2025-09-16 13:58:16.636 INFO 9 --- [prometheus-minute-schedule-1,b4fd83b61f2df905,f08a19af740dda66] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:16.639 INFO 9 --- [prometheus-minute-schedule-1,b4fd83b61f2df905,f08a19af740dda66] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:16.805 WARN 9 --- [ocp-async-1,354d738b0c8b445e,27f8fac3b70ec97f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:16.805 INFO 9 --- [ocp-async-1,6fcc59c4e8d4277c,eb558d4c793284f2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:18.576 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:18.576 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:18.805 WARN 9 --- [ocp-async-5,5de6449cbb65a50d,7cc1151ab07a7f6d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:18.806 INFO 9 --- [ocp-async-10,7c18f79dee827ad6,6818d102fd1595e9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:19.210 INFO 9 --- [ocp-schedules-29,ccdbc22909ddf68c,fbaa21ad62afa524] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:58:19.212 INFO 9 --- [ocp-schedules-29,ccdbc22909ddf68c,fbaa21ad62afa524] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:58:19.636 INFO 9 --- [prometheus-minute-schedule-1,1ce01b874df609ae,31d846ed69c094d4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:19.639 INFO 9 --- [prometheus-minute-schedule-1,1ce01b874df609ae,31d846ed69c094d4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:58:20.003484+08:00, lastProcessTime=2025-09-16T13:58:10.003207+08:00 2025-09-16 13:58:20.121 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:58:20.003484+08:00 2025-09-16 13:58:20.186 INFO 9 --- [ocp-async-6,0418706e30f55a7e,66e1f9e5d943f10d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:58:20.636 INFO 9 --- [prometheus-cache-monitor1,94d30fb67b1b1d4d,819e2564181c6e05] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:58:20.636 INFO 9 --- [prometheus-cache-monitor1,94d30fb67b1b1d4d,819e2564181c6e05] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:58:20.806 WARN 9 --- [ocp-async-8,1abbcdb80e74a51c,9436ec33b976f3cb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:20.806 INFO 9 --- [ocp-async-9,d7f26d1ecae6b1d6,9b7eff6ee655bf8f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:21.576 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:21.577 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:21.824 INFO 9 --- [ocp-schedules-10,6b7f69a0d6741108,506f3b8d92c3b861] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:58:21.830 WARN 9 --- [scanner-1383358-1,6b7f69a0d6741108,25cc89774a969e2b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:58:21.835 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,21ae20c61c72331b,722665af7b18a742] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=21ae20c61c72331b, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:58:21.835 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,21ae20c61c72331b,722665af7b18a742] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=21ae20c61c72331b, duration=1 ms] 2025-09-16 13:58:21.839 INFO 9 --- [alarm-detect-6,6b7f69a0d6741108,89def85473cf737d] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:58:21.842 INFO 9 --- [alarm-detect-17,6b7f69a0d6741108,f76c819aac6d73d1] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:58:21.842 INFO 9 --- [alarm-detect-19,6b7f69a0d6741108,6eafc04ba3c26cb3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:58:21.855 INFO 9 --- [alarm-detect-1,6b7f69a0d6741108,ba51b1fae1cb4f77] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:58:22.636 INFO 9 --- [prometheus-minute-schedule-1,c6d40fdcf7e93b87,dcb814a34d13b968] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:22.640 INFO 9 --- [prometheus-minute-schedule-1,c6d40fdcf7e93b87,dcb814a34d13b968] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:22.806 WARN 9 --- [ocp-async-6,a915a1d14f8b3b76,875a18f4c0a65ae5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:22.806 INFO 9 --- [ocp-async-1,2927a78b75f05763,bb372b242fc1fa2f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:24.578 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:24.578 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:24.806 WARN 9 --- [ocp-async-5,c12041ca6ab024ec,7b08ff30a7a86908] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:24.806 INFO 9 --- [ocp-async-5,1f91a5d518d86390,b0477b1890ae1101] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:24.850 INFO 9 --- [ocp-schedules-12,f14676e1a237bf58,20e93bcb157f70b1] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:58:25.636 INFO 9 --- [prometheus-minute-schedule-1,7dca43689021d887,5cdfec1baa089df0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:25.640 INFO 9 --- [prometheus-minute-schedule-1,7dca43689021d887,5cdfec1baa089df0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:26.806 WARN 9 --- [ocp-async-4,1a1aab757897b772,321e8c5eb5479e1d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:26.806 INFO 9 --- [ocp-async-3,132a15fb1824753a,f7f1e4adde4bce1b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:27.578 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:27.579 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:28.636 INFO 9 --- [prometheus-minute-schedule-1,4d663cbfdda78d5d,a2d7080c53beb492] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:28.639 INFO 9 --- [prometheus-minute-schedule-1,4d663cbfdda78d5d,a2d7080c53beb492] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:28.806 WARN 9 --- [ocp-async-6,5717a55770c61962,670e63d057e4d2e1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:28.806 INFO 9 --- [ocp-async-2,2ec5f7b32c227202,797942f245eb34ca] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:29.217 INFO 9 --- [ocp-schedules-2,aba4ad0abf9cdbaf,c6dfedd64e31bdd1] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:58:29.219 INFO 9 --- [ocp-schedules-2,aba4ad0abf9cdbaf,c6dfedd64e31bdd1] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:58:29.938 INFO 9 --- [ocp-schedules-25,3b01c17e4f228f25,4f74488438b76261] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:58:29.941 INFO 9 --- [ocp-schedules-20,a5df988ea5abe2d4,bd6a747dae4d68d5] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:58:29.941 INFO 9 --- [ocp-schedules-11,ff5cfbbadbf8058c,9262659027b1893f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:58:29.942 INFO 9 --- [ocp-schedules-14,99be22b91ef44699,42fcb01cafe9ae7a] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:58:29.943 INFO 9 --- [ocp-schedules-20,a5df988ea5abe2d4,bd6a747dae4d68d5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:29.943 INFO 9 --- [ocp-schedules-11,ff5cfbbadbf8058c,9262659027b1893f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:29.943 INFO 9 --- [ocp-schedules-14,99be22b91ef44699,42fcb01cafe9ae7a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:29.943 INFO 9 --- [ocp-schedules-14,99be22b91ef44699,42fcb01cafe9ae7a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:58:29.944 INFO 9 --- [ocp-schedules-3,f03f5f78f801266a,9956c318019797ab] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:58:29.945 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:58:29.945 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:58:29.945 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:58:29.945 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:58:29.945 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:58:29.945 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:58:29.945 INFO 9 --- [ocp-schedules-24,48edbbd078c5bd41,057b9903c9abebe4] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:58:29.945 INFO 9 --- [ocp-schedules-5,a4774201adfe3d74,2d57572576804e6d] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:58:29.945 INFO 9 --- [host-check-clockdiff1,48edbbd078c5bd41,eedb93140f889432] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:58:29.945 INFO 9 --- [host-check-agent-status1,a4774201adfe3d74,e2c4852ce4e31bfe] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:58:29.945 INFO 9 --- [host-check-agent-status2,a4774201adfe3d74,9b30a4e33e306301] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:58:29.945 INFO 9 --- [host-check-clockdiff2,48edbbd078c5bd41,edc3596cacb340fe] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:58:29.945 INFO 9 --- [host-check-clockdiff3,48edbbd078c5bd41,b8c08c4b64227f01] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:58:29.945 INFO 9 --- [host-check-clockdiff4,48edbbd078c5bd41,425ddb41c9f85642] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:58:29.946 INFO 9 --- [host-check-agent-status3,a4774201adfe3d74,b6b5a705382727f6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:58:29.946 INFO 9 --- [host-check-clockdiff5,48edbbd078c5bd41,7f286da399d5e5e0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:58:29.946 INFO 9 --- [host-check-agent-status4,a4774201adfe3d74,68bf6fe9f59dcfe6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:58:29.946 INFO 9 --- [host-check-clockdiff6,48edbbd078c5bd41,3f712dccd3338875] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:58:29.946 INFO 9 --- [host-check-agent-status5,a4774201adfe3d74,879b0822beb2f76a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:58:29.946 INFO 9 --- [host-check-agent-status6,a4774201adfe3d74,5c191277e574b27a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:58:29.947 INFO 9 --- [ocp-schedules-21,4c8871c2cea84d37,554c213ebf51c960] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:58:29.954 INFO 9 --- [host-check-clockdiff3,48edbbd078c5bd41,b8c08c4b64227f01] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002309 -1 -1 , error= 2025-09-16 13:58:29.954 INFO 9 --- [host-check-clockdiff4,48edbbd078c5bd41,425ddb41c9f85642] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002309 -1 -1 , error= 2025-09-16 13:58:29.954 INFO 9 --- [host-check-clockdiff6,48edbbd078c5bd41,3f712dccd3338875] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002309 -1 -1 , error= 2025-09-16 13:58:29.956 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:29.956 INFO 9 --- [ocp-schedules-13,3f7cb4f158b47db0,8d626d87922fb917] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2025-09-16 13:58:29.956 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:58:29.956 INFO 9 --- [host-check-clockdiff2,48edbbd078c5bd41,edc3596cacb340fe] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002309 -2 -2 , error= 2025-09-16 13:58:29.956 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:58:29.956 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:58:29.956 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:58:29.957 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:58:29.957 INFO 9 --- [ocp-schedules-13,3f7cb4f158b47db0,8d626d87922fb917] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:29.957 INFO 9 --- [host-check-agent-status2,a4774201adfe3d74,9b30a4e33e306301] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:58:29.957 INFO 9 --- [host-check-clockdiff5,48edbbd078c5bd41,7f286da399d5e5e0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002309 -1 -1 , error= 2025-09-16 13:58:29.957 INFO 9 --- [host-check-agent-status1,a4774201adfe3d74,e2c4852ce4e31bfe] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:58:29.957 INFO 9 --- [host-check-agent-status4,a4774201adfe3d74,68bf6fe9f59dcfe6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:58:29.957 INFO 9 --- [host-check-agent-status3,a4774201adfe3d74,b6b5a705382727f6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:58:29.957 INFO 9 --- [host-check-agent-status5,a4774201adfe3d74,879b0822beb2f76a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:58:29.957 INFO 9 --- [host-check-agent-status6,a4774201adfe3d74,5c191277e574b27a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:29.957 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:29.958 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:58:29.958 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:58:29.958 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:58:29.958 INFO 9 --- [host-check-agent-status4,a4774201adfe3d74,68bf6fe9f59dcfe6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:58:29.958 INFO 9 --- [host-check-agent-status5,a4774201adfe3d74,879b0822beb2f76a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:58:29.958 INFO 9 --- [host-check-agent-status2,a4774201adfe3d74,9b30a4e33e306301] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:58:29.958 INFO 9 --- [host-check-agent-status1,a4774201adfe3d74,e2c4852ce4e31bfe] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:58:29.958 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:58:29.958 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:58:29.958 INFO 9 --- [host-check-agent-status3,a4774201adfe3d74,b6b5a705382727f6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:58:29.958 INFO 9 --- [host-check-agent-status6,a4774201adfe3d74,5c191277e574b27a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:29.962 INFO 9 --- [ocp-schedules-17,bc39d41420671560,2173125158680a76] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:58:29.963 INFO 9 --- [ocp-schedules-7,1ee0513a6d461575,4bcd53cd1d782112] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:58:29.969 INFO 9 --- [ocp-schedules-17,bc39d41420671560,2173125158680a76] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:58:29.970 INFO 9 --- [ocp-schedules-7,1ee0513a6d461575,4bcd53cd1d782112] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:58:29.971 INFO 9 --- [ocp-schedules-23,7756c2d87559af40,9f9ed8ee13ed8137] c.o.o.s.common.scheduled.OcpSchedules : Cleanup ocp connection pools. 2025-09-16 13:58:29.971 INFO 9 --- [ocp-schedules-23,7756c2d87559af40,9f9ed8ee13ed8137] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2025-09-16 13:58:29.973 INFO 9 --- [host-check-agent-status5,a4774201adfe3d74,879b0822beb2f76a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-agent-status2,a4774201adfe3d74,9b30a4e33e306301] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-agent-status6,a4774201adfe3d74,5c191277e574b27a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-agent-status3,a4774201adfe3d74,b6b5a705382727f6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:58:29.973 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:58:29.974 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:58:29.974 INFO 9 --- [host-check-agent-status4,a4774201adfe3d74,68bf6fe9f59dcfe6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:58:29.975 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:58:29.974285469+08:00 2025-09-16 13:58:29.975 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:58:29.974325971+08:00 2025-09-16 13:58:29.975 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:58:29.974403255+08:00 2025-09-16 13:58:29.975 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:58:29.974122528+08:00 2025-09-16 13:58:29.975 INFO 9 --- [host-check-agent-status1,a4774201adfe3d74,e2c4852ce4e31bfe] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:58:29.975 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:58:29.975+08:00 2025-09-16 13:58:29.975 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:58:29.975+08:00 2025-09-16 13:58:29.976 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:58:29.975+08:00 2025-09-16 13:58:29.976 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:58:29.975+08:00 2025-09-16 13:58:29.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:29.976 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:58:29.974937458+08:00 2025-09-16 13:58:29.976 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:58:29.974971988+08:00 2025-09-16 13:58:29.976 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:58:29.976+08:00 2025-09-16 13:58:29.976 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:58:29.976+08:00 2025-09-16 13:58:29.977 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:29.977 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:58:29.975+08:00 and status AVAILABLE 2025-09-16 13:58:29.977 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:58:29.975+08:00 and status AVAILABLE 2025-09-16 13:58:29.977 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:58:29.975+08:00 and status AVAILABLE 2025-09-16 13:58:29.977 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:58:29.975+08:00 and status AVAILABLE 2025-09-16 13:58:29.977 INFO 9 --- [host-check-agent-status2,a4774201adfe3d74,9b30a4e33e306301] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:58:29.977 INFO 9 --- [host-check-agent-status2,a4774201adfe3d74,9b30a4e33e306301] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:58:29.977 INFO 9 --- [host-check-agent-status2,a4774201adfe3d74,9b30a4e33e306301] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status3,a4774201adfe3d74,b6b5a705382727f6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status3,a4774201adfe3d74,b6b5a705382727f6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status3,a4774201adfe3d74,b6b5a705382727f6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status6,a4774201adfe3d74,5c191277e574b27a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status6,a4774201adfe3d74,5c191277e574b27a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status6,a4774201adfe3d74,5c191277e574b27a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status5,a4774201adfe3d74,879b0822beb2f76a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status5,a4774201adfe3d74,879b0822beb2f76a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:58:29.978 INFO 9 --- [pool-overview-container-4,133d9fc82b7be502,e46a14dce59da493] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:58:29.978 INFO 9 --- [host-check-agent-status5,a4774201adfe3d74,879b0822beb2f76a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:58:29.978 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:58:29.976+08:00 and status AVAILABLE 2025-09-16 13:58:29.978 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:58:29.976+08:00 and status AVAILABLE 2025-09-16 13:58:29.979 INFO 9 --- [host-check-agent-status1,a4774201adfe3d74,e2c4852ce4e31bfe] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:58:29.979 INFO 9 --- [host-check-agent-status1,a4774201adfe3d74,e2c4852ce4e31bfe] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:58:29.979 INFO 9 --- [host-check-agent-status1,a4774201adfe3d74,e2c4852ce4e31bfe] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:58:29.979 INFO 9 --- [host-check-agent-status4,a4774201adfe3d74,68bf6fe9f59dcfe6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:58:29.979 INFO 9 --- [host-check-agent-status4,a4774201adfe3d74,68bf6fe9f59dcfe6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:58:29.979 INFO 9 --- [host-check-agent-status4,a4774201adfe3d74,68bf6fe9f59dcfe6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:58:29.979 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:58:29.980 INFO 9 --- [pool-overview-container-2,ea251a75e71341b7,10ea274bf9a13337] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:58:29.981 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:58:29.981 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:58:29.981 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:29.981 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:58:29.982 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:58:29.982 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2025-09-16 13:58:29.982 INFO 9 --- [ocp-schedules-11,ff5cfbbadbf8058c,9262659027b1893f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:58:29.982 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:58:29.982 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:58:29.985 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:58:29.986 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:58:29.987 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:58:29.987 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:58:29.988 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:58:29.988 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:58:29.988 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:58:29.988 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:29.988 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:58:29.989 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:58:29.989 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:58:29.989 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:29.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:29.992 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:58:29.993 INFO 9 --- [pool-12-thread-3,133d9fc82b7be502,14549624787ed3ea] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get outline history 2025-09-16 13:58:29.993 INFO 9 --- [pool-12-thread-4,133d9fc82b7be502,081c5f8928c7cbbf] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster session stat 2025-09-16 13:58:29.993 INFO 9 --- [pool-12-thread-1,133d9fc82b7be502,f76c602b95e93e2a] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to get cluster trans stat 2025-09-16 13:58:29.994 INFO 9 --- [pool-12-thread-2,133d9fc82b7be502,a922836349213cd0] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get Cluster Sql Stat 2025-09-16 13:58:29.994 INFO 9 --- [pool-12-thread-2,133d9fc82b7be502,a922836349213cd0] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster slow Sql Stat 2025-09-16 13:58:29.995 INFO 9 --- [ForkJoinPool-10-worker-1,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:58:29.995 INFO 9 --- [ForkJoinPool-10-worker-10,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 13:58:29.996 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,e8b6247cfe1a74fc,b503337379f66d40] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=zhengqi&ObClusterId=1&version=2, client=10.232.140.0, traceId=e8b6247cfe1a74fc, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getRootServiceInfo(String,Long,String,Long,boolean,Integer), args=zhengqi,1,false,2,] 2025-09-16 13:58:29.996 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,e8b6247cfe1a74fc,b503337379f66d40] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=e8b6247cfe1a74fc, duration=1 ms] 2025-09-16 13:58:29.996 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get tenant session stat of zhengqi 2025-09-16 13:58:29.996 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get session of zhengqi 2025-09-16 13:58:29.997 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:29.998 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2025-09-16 13:58:29.998 INFO 9 --- [pool-12-thread-1,133d9fc82b7be502,f76c602b95e93e2a] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to attach trans id 2025-09-16 13:58:29.998 INFO 9 --- [pool-12-thread-1,133d9fc82b7be502,f76c602b95e93e2a] c.o.o.p.t.i.ObTransactionDiagServiceImpl : finish fetching trans data 2025-09-16 13:58:30.001 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:30.003 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:30.003 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:30.004 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:30.004 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:30.004 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:58:30.004 INFO 9 --- [pool-overview-container-5,7945ceea7475ed51,6461a534bc2ee2d7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:58:30.004279+08:00, lastProcessTime=2025-09-16T13:58:20.003484+08:00 2025-09-16 13:58:30.006 INFO 9 --- [pool-overview-container-5,7945ceea7475ed51,6461a534bc2ee2d7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ SVR_IP, SVR_PORT, ZONE, CPU_CAPACITY, CPU_CAPACITY_MAX, CPU_ASSIGNED, CPU_ASSIGNED_MAX, MEM_CAPACITY, MEM_CAPACITY AS MEM_CAPACITY_MAX, MEM_ASSIGNED, MEM_ASSIGNED AS MEM_ASSIGNED_MAX, LOG_DISK_CAPACITY, LOG_DISK_ASSIGNED, LOG_DISK_IN_USE, DATA_DISK_CAPACITY, DATA_DISK_IN_USE FROM oceanbase.GV$OB_SERVERS 2025-09-16 13:58:30.010 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.012 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.159, 2882] 2025-09-16 13:58:30.014 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.014 INFO 9 --- [pool-12-thread-2,133d9fc82b7be502,a922836349213cd0] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster anomaly sql Stat 2025-09-16 13:58:30.016 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.111, 2882] 2025-09-16 13:58:30.018 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.019 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.019 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.104, 2882] 2025-09-16 13:58:30.020 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.020 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:58:30.020 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.021 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:58:30.022 INFO 9 --- [pool-12-thread-2,133d9fc82b7be502,a922836349213cd0] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching cluster sql stat 2025-09-16 13:58:30.022 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.85, 2882] 2025-09-16 13:58:30.023 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.025 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.54, 2882] 2025-09-16 13:58:30.025 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.026 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:58:30.026 INFO 9 --- [ocp-schedules-13,3f7cb4f158b47db0,8d626d87922fb917] .o.o.s.t.b.c.AbstractShardingClusterTask : Check root service executed completed, allCount=1, successCount=1 2025-09-16 13:58:30.029 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:58:30.031 INFO 9 --- [ocp-schedules-2,1e5954cf4bf028c4,1763f07c078eea0d] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:58:30.031 INFO 9 --- [ocp-schedules-2,1e5954cf4bf028c4,1763f07c078eea0d] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:58:30.031 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:58:30.032 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:58:30.032 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:58:30.032 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:58:30.032 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:58:30.033 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:30.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.035 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:58:30.036 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:58:30.038 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:58:30.038 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:58:30.038 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:58:30.038 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:58:30.038 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:58:30.039 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.039 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:58:30.040 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:58:30.041 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.042 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:58:30.049 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:30.050 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:30.050 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.050 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:30.050 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:30.051 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:30.051 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:58:30.052 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:58:30.059 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.060 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:58:30.069 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.069 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:30.070 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:58:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:58:30.075 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:58:30.078 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:58:30.078 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:58:30.078 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:30.079 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:58:30.079 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:58:30.080 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:58:30.081 INFO 9 --- [ocp-schedules-26,4754e756fe453722,1d6575ef869455f8] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:58:30.082 INFO 9 --- [ocp-schedules-26,4754e756fe453722,1d6575ef869455f8] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 13:58:30.085 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:58:30.085 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:58:30.086 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:58:30.086 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:58:30.086 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:58:30.086 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.087 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 13:58:30.087 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:58:30.087 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:58:30.087 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.088 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:58:30.091 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.092 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 13:58:30.092 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.093 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.093 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:30.093 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:58:30.093 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:58:30.094 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get deadlock of zhengqi 2025-09-16 13:58:30.097 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:30.098 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:30.098 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:30.098 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:30.099 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:30.101 INFO 9 --- [prometheus-second-schedule-1,c9ef55bb67461336,75713bf2166bde6b] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:58:30.105 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:58:30.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.109 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:30.110 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 13:58:30.116 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.117 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:58:30, 2025-09-16 13:58:30] 2025-09-16 13:58:30.120 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.122 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 13:58:30.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:30.125 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:58:30.125 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:58:30.126 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:58:30.126 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:58:30.127 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:58:30.132 INFO 9 --- [host-check-host-status1,f03f5f78f801266a,f1e04f4fc3da6782] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:58:30.132 INFO 9 --- [host-check-host-status4,f03f5f78f801266a,367d30a3750fbfb0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:58:30.133 INFO 9 --- [host-check-host-status2,f03f5f78f801266a,e1e0ada104bd718a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:58:30.133 INFO 9 --- [host-check-host-status5,f03f5f78f801266a,eff27ae514f7dddf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:58:30.133 INFO 9 --- [host-check-host-status3,f03f5f78f801266a,ce48db3708cd34cc] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:58:30.135 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:58:30.137 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 13:58:30.138 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.138 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:58:30.139 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:58:30, 2025-09-16 13:58:30] 2025-09-16 13:58:30.140 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.141 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 13:58:30.141 INFO 9 --- [host-check-host-status6,f03f5f78f801266a,86d15f7e4bfdc331] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:58:30.142 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.142 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:30.143 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:58:30.004279+08:00 2025-09-16 13:58:30.145 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.146 INFO 9 --- [ForkJoinPool-10-worker-1,133d9fc82b7be502,eaaf71016de03d0a] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 13:58:30.148 INFO 9 --- [pool-12-thread-3,133d9fc82b7be502,14549624787ed3ea] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2025-09-16 13:58:30.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.162 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:30.164 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 13:58:30.166 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.167 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 13:58:30, 2025-09-16 13:58:30] 2025-09-16 13:58:30.169 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.p.o.i.OasSessionStatServiceImpl : finish fetching tenant session data of zhengqi 2025-09-16 13:58:30.169 INFO 9 --- [ForkJoinPool-10-worker-10,133d9fc82b7be502,e80fd3762a64d70d] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching tenant session stat of zhengqi 2025-09-16 13:58:30.169 INFO 9 --- [pool-12-thread-4,133d9fc82b7be502,081c5f8928c7cbbf] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2025-09-16 13:58:30.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:30.187 INFO 9 --- [ocp-async-3,7eb448703d60e3e1,e7d4957d3fcdcf1d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:58:30.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.192 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:30.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:58:30.221 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.221 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:58:30.236 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:58:30.250 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:30.251 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.252 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:30.257 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:58:30.260 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:58:30.263 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:30.264 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:30.277 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:58:30.279 INFO 9 --- [ocp-schedules-4,4f4122f5760b748a,d83573d85d0276e5] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:58:30.280 INFO 9 --- [ocp-schedules-4,4f4122f5760b748a,d83573d85d0276e5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:30.280 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:58:30.280 INFO 9 --- [ocp-schedules-4,4f4122f5760b748a,d83573d85d0276e5] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:58:30.338 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:58:30.352 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:30.354 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:30.355 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:58:30.369 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:58:30.369 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:58:30.369 INFO 9 --- [ocp-schedules-20,a5df988ea5abe2d4,bd6a747dae4d68d5] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:58:30.409 INFO 9 --- [ocp-schedules-8,8709dd94fe17d0be,917a3c7074e80fb8] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:58:30.579 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:30.579 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:30.597 INFO 9 --- [ocp-schedules-7,70bfef44d77cc692,69622531e0ad1631] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:58:30.599 INFO 9 --- [ocp-schedules-7,70bfef44d77cc692,69622531e0ad1631] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:58:30.599 INFO 9 --- [ocp-schedules-7,70bfef44d77cc692,69622531e0ad1631] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:58:30.806 WARN 9 --- [ocp-async-4,23273e2e3e18fcd2,9aeec8380dfb21ef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:30.806 INFO 9 --- [ocp-async-8,ad5d50950984b93b,c04b05ac138d86ef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:30.863 INFO 9 --- [ocp-schedules-2,a3cc14479c59255e,6674d6404780bb76] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:58:30.886 INFO 9 --- [host-check-clockdiff1,48edbbd078c5bd41,eedb93140f889432] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002310 -1 -1 , error= 2025-09-16 13:58:30.991 INFO 9 --- [ocp-schedules-26,684ee7a5415f7aba,ff41bf1de5079835] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:58:30.991 INFO 9 --- [ocp-schedules-26,684ee7a5415f7aba,ff41bf1de5079835] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:58:31.495 INFO 9 --- [ocp-schedules-9,f6e31d0c3b36161e,d373fa89cce2915c] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:58:31.495 INFO 9 --- [ocp-schedules-9,f6e31d0c3b36161e,d373fa89cce2915c] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002311 2025-09-16 13:58:31.496 INFO 9 --- [ocp-schedules-9,f6e31d0c3b36161e,d373fa89cce2915c] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:58:31.636 INFO 9 --- [prometheus-minute-schedule-1,b31ef92fe5e6f8c3,3a9c40584c5d4725] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:31.639 INFO 9 --- [prometheus-minute-schedule-1,b31ef92fe5e6f8c3,3a9c40584c5d4725] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:31.668 INFO 9 --- [ocp-schedules-4,776a908b742a660f,3b619153936befd5] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:58:31.710 INFO 9 --- [ocp-schedules-21,166790980d61414b,074258347cddfdef] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:58:31.710 INFO 9 --- [ocp-schedules-21,166790980d61414b,074258347cddfdef] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 13:58:31.710 INFO 9 --- [ocp-schedules-21,166790980d61414b,074258347cddfdef] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:58:31.710 INFO 9 --- [ocp-schedules-21,166790980d61414b,074258347cddfdef] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:58:31.711 INFO 9 --- [ocp-schedules-21,166790980d61414b,074258347cddfdef] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:58:31.711 INFO 9 --- [ocp-schedules-21,166790980d61414b,074258347cddfdef] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:58:31.724 INFO 9 --- [ocp-schedules-20,b7662440ef6c028e,ae579bc129f72f7e] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:58:31.798 INFO 9 --- [ocp-schedules-23,6a213e1ade2a969a,cfb664f4104618d5] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 13:58:31.799 INFO 9 --- [ocp-schedules-23,6a213e1ade2a969a,cfb664f4104618d5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:31.812 INFO 9 --- [ocp-schedules-23,6a213e1ade2a969a,cfb664f4104618d5] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 13:58:31.857 INFO 9 --- [ocp-schedules-15,b5b0ef83bb87e5d5,2b64f9a0fb3a519c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:58:31.862 WARN 9 --- [scanner-1383517-1,b5b0ef83bb87e5d5,504e3fcedb861050] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:58:32.073 INFO 9 --- [ocp-schedules-5,88bcc262696f8456,ec58ea3e37ac56d3] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster system event. 2025-09-16 13:58:32.074 INFO 9 --- [ocp-schedules-5,88bcc262696f8456,ec58ea3e37ac56d3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:32.101 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:32.104 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) ocp_query */ timestamp as gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, rs_svr_ip, rs_svr_port FROM DBA_OB_ROOTSERVICE_EVENT_HISTORY WHERE 1=1 AND timestamp > :startTime AND timestamp <= :endTime AND ( not (module = "balancer" AND event IN ("start_sql_bkgd_task","finish_sql_bkgd_task")) AND not (module = "schema_recycler")) ORDER BY timestamp ASC LIMIT :limit, args: [2025-09-16 10:42:23.324905, 2025-09-16 13:58:32.079, 1000] 2025-09-16 13:58:32.105 INFO 9 --- [Sync system event1,,] .o.o.o.i.c.ClusterSystemEventServiceImpl : Finished sync system events: cluster 1, startTime 2025-09-16 10:42:23.324905, endTime 2025-09-16 13:58:32.079 2025-09-16 13:58:32.122 INFO 9 --- [Sync system event1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:32.126 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:32.141 INFO 9 --- [Sync system event1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ QUERY_TIMEOUT(60000000) ocp_query */ timestamp as gmt_create, module, event, name1, value1, name2, value2, name3, value3, name4, value4, name5, value5, name6, value6, extra_info, svr_ip, svr_port FROM DBA_OB_SERVER_EVENT_HISTORY WHERE 1=1 AND timestamp > :startTime AND timestamp <= :endTime AND ( (module = "sql") OR (module = "daily_merge") OR (module = "election") OR (module = "physical_restore") OR (module = "observice") OR (module = "observer") OR (module = "clog_restore") OR (module = "warmup") OR (module = "log_archive") OR (module = "archive_log") OR (module = "minor_merge") OR (module = "ddl" AND event IN ("create_partition","batch_create_partition","add_replica","remove_member","batch_remove_member","batch_modify_quorum","batch_change_replica","migrate_replica","remove_replica","rebuild_replica")) OR (module = "freeze" AND event IN ("do minor freeze fail")) OR (module = "storage" AND event IN ("add_replica failed","migrate_replica failed","reubild_replica failed","change_replica failed","log is new enough, turn off rebuild flag","remove_replica failed","restore follower replica failed","restore_replica failed","batch change_replica failed","copy global index failed","restore_standby_replica failed","rebuild_replica failed"))) ORDER BY timestamp ASC LIMIT :limit, args: [2025-09-16 10:43:27.467991, 2025-09-16 13:58:32.109, 1000] 2025-09-16 13:58:32.143 INFO 9 --- [Sync system event1,,] .o.o.o.i.c.ClusterSystemEventServiceImpl : Finished sync server events: cluster 1, startTime 2025-09-16 10:43:27.467991, endTime 2025-09-16 13:58:32.109 2025-09-16 13:58:32.143 INFO 9 --- [ocp-schedules-5,88bcc262696f8456,ec58ea3e37ac56d3] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync system event executed completed, allCount=1, successCount=1 2025-09-16 13:58:32.806 WARN 9 --- [ocp-async-6,09b962817fc54c22,536985365da86bb0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:32.806 INFO 9 --- [ocp-async-9,59d2acc0cc2753e3,6f92ab0e50d9890d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:32.927 INFO 9 --- [ocp-schedules-4,e9ee9a926d8e8fcf,7587732a53b5bbdf] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2025-09-16 13:58:32.927 INFO 9 --- [ocp-schedules-4,e9ee9a926d8e8fcf,7587732a53b5bbdf] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2025-09-16 13:58:32.942 INFO 9 --- [pool-71-thread-1,e9ee9a926d8e8fcf,11c2e620493ad3ac] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect mini compaction info 2025-09-16 13:58:32.964 INFO 9 --- [pool-71-thread-1,e9ee9a926d8e8fcf,11c2e620493ad3ac] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:32.966 INFO 9 --- [pool-71-thread-1,e9ee9a926d8e8fcf,11c2e620493ad3ac] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, MIN(unix_timestamp(`start_time`)*1000000) AS min_start_time, MAX(unix_timestamp(`finish_time`)*1000000) AS max_finish_time, SUM(occupy_size) AS occupy_size, SUM(total_row_count) AS total_row_count, COUNT(1) AS tablet_count FROM GV$OB_TABLET_COMPACTION_HISTORY WHERE type = 'MINI_MERGE' AND unix_timestamp(`finish_time`)*1000000 > ? AND unix_timestamp(`finish_time`)*1000000 <= ? GROUP BY tenant_id;, args: [1758002012000000, 1758002312000000] 2025-09-16 13:58:32.986 INFO 9 --- [pool-71-thread-1,e9ee9a926d8e8fcf,11c2e620493ad3ac] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect mini compaction info 2025-09-16 13:58:32.987 INFO 9 --- [ocp-schedules-4,e9ee9a926d8e8fcf,7587732a53b5bbdf] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2025-09-16 13:58:33.481 INFO 9 --- [ocp-schedules-28,30df4acb5a4d9d8c,19cca5f75b2172d5] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:58:33.579 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:33.580 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:33.618 INFO 9 --- [ocp-schedules-11,65b3a1933dead563,b4fb997564ca752c] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:58:33.618+08:00, clusters=[1] 2025-09-16 13:58:33.618 INFO 9 --- [ocp-schedules-11,65b3a1933dead563,b4fb997564ca752c] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:58:34.187 INFO 9 --- [ocp-schedules-12,5a7dc2843590c3a9,dfe4a4a5ed5a2c55] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:58:34.187 INFO 9 --- [ocp-schedules-12,5a7dc2843590c3a9,dfe4a4a5ed5a2c55] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:58:34.188 INFO 9 --- [ocp-schedules-12,5a7dc2843590c3a9,dfe4a4a5ed5a2c55] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:58:34.203 INFO 9 --- [ocp-schedules-12,5a7dc2843590c3a9,dfe4a4a5ed5a2c55] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:58:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:58:34.636 INFO 9 --- [prometheus-minute-schedule-1,9947303e02fe8377,7ac4ce1e08437443] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:34.640 INFO 9 --- [prometheus-minute-schedule-1,9947303e02fe8377,7ac4ce1e08437443] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:34.732 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2025-09-16 13:58:34.734 INFO 9 --- [ocp-schedules-27,3a5f9388ff9ac2ae,fe6bc1a1b28a502c] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:58:34.739 INFO 9 --- [ocp-schedules-27,3a5f9388ff9ac2ae,fe6bc1a1b28a502c] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:58:34.739 INFO 9 --- [ocp-schedules-27,3a5f9388ff9ac2ae,fe6bc1a1b28a502c] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:58:34.741 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:58:34.742 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:58:34.756 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:58:34.757 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:58:34.769 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:58:34.770 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:58:34.783 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:58:34.784 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:58:34.798 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:58:34.799 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:58:34.806 WARN 9 --- [ocp-async-1,4c034635c5d27178,2187fcc279fa1414] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:34.806 INFO 9 --- [ocp-async-10,bf31eb4fda7c7828,b54c4a3e90d2df2a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:34.813 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:34.814 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:34.828 INFO 9 --- [ocp-schedules-5,5bc07e07adc4135e,4c22763c0fd34084] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper finished, credentialSize=6, cachedSize=6 2025-09-16 13:58:34.853 INFO 9 --- [ocp-schedules-28,70e367ceb8178753,e36fb0f42a56192d] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:58:35.721 INFO 9 --- [ocp-schedules-11,b8d42635ad1f6331,c13a5d9b3514c4cd] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:58:35.721+08:00, clusters=[1] 2025-09-16 13:58:35.767 INFO 9 --- [ocp-schedules-11,b8d42635ad1f6331,c13a5d9b3514c4cd] c.o.o.p.s.i.alarm.SlowSqlDataSource : collect SlowSqlData for zhengqi, save 1 to SqlAggregateData 2025-09-16 13:58:36.580 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:36.581 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:36.807 WARN 9 --- [ocp-async-4,95c4bf36cca8ba6b,4fe35ec25cf2369f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:36.807 INFO 9 --- [ocp-async-7,b2587da71ba2c866,b3762dac1c52f2a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:37.636 INFO 9 --- [prometheus-minute-schedule-1,91bd6abdd28a1028,7af727415cb4035e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:37.639 INFO 9 --- [prometheus-minute-schedule-1,91bd6abdd28a1028,7af727415cb4035e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:37.943 INFO 9 --- [ocp-schedules-21,3ce4728a0b885a47,5cb3f322018a916a] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:58:37.945 INFO 9 --- [ocp-schedules-21,3ce4728a0b885a47,5cb3f322018a916a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:37.967 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:37.967 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:58:37.980 INFO 9 --- [ocp-schedules-21,3ce4728a0b885a47,5cb3f322018a916a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:58:38.807 WARN 9 --- [ocp-async-6,f2fca2ed03fadecb,ba81ef4a6bddde6f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:38.807 INFO 9 --- [ocp-async-3,df09e8e8dbb5dbd5,4ed14f808195bb00] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:39.223 INFO 9 --- [ocp-schedules-16,b5a243781951ad8b,49cace1d4a99fc8b] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:58:39.225 INFO 9 --- [ocp-schedules-16,b5a243781951ad8b,49cace1d4a99fc8b] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:58:39.581 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:39.582 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:39.943 INFO 9 --- [ocp-schedules-7,29c2bbc976b01abf,5ffd173f26985f73] c.o.o.m.service.SeriesIdCleanService : Clean series by list started. 2025-09-16 13:58:39.943 INFO 9 --- [ocp-schedules-7,29c2bbc976b01abf,5ffd173f26985f73] c.o.o.m.service.SeriesIdCleanService : Clean series by list finished. 2025-09-16 13:58:39.943 INFO 9 --- [ocp-schedules-7,29c2bbc976b01abf,5ffd173f26985f73] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache started, seriesIdKeySize=16769 2025-09-16 13:58:40.002 INFO 9 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:58:40.002 INFO 9 --- [ocp-schedules-11,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:58:40.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:58:40.004816+08:00, lastProcessTime=2025-09-16T13:58:30.004279+08:00 2025-09-16 13:58:40.041 INFO 9 --- [ocp-schedules-3,16514ed9faa53629,a0435bf5d2c22d4a] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:58:40.041 INFO 9 --- [ocp-schedules-3,16514ed9faa53629,a0435bf5d2c22d4a] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:58:40.051 INFO 9 --- [ocp-schedules-9,fc46d59a04386d36,598b2a80d3e7ff8b] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:58:40.051 INFO 9 --- [ocp-schedules-9,fc46d59a04386d36,598b2a80d3e7ff8b] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:58:40.051 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:58:40.051 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:58:40.051 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:58:40.051 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:58:40.055 INFO 9 --- [ocp-schedules-9,fc46d59a04386d36,598b2a80d3e7ff8b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:58:40.055 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:40.055 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:58:40.055 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:58:40.055 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:58:40.056 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:40.056 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:58:40.056 INFO 9 --- [ocp-schedules-9,fc46d59a04386d36,598b2a80d3e7ff8b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:58:40.056 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:58:40.056 INFO 9 --- [Collect all tenants major compactions2,16514ed9faa53629,1381b904f8a740b7] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:58:40.056 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:58:40.056 INFO 9 --- [Collect all tenants major compactions1,16514ed9faa53629,2a94236d409dfbf2] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:58:40.056 INFO 9 --- [Collect all tenants major compactions3,16514ed9faa53629,0ab3ee001071be8f] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:58:40.070 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:58:40.070 INFO 9 --- [ocp-schedules-9,fc46d59a04386d36,598b2a80d3e7ff8b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:58:40.071 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:58:40.071 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:58:40.071 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:58:40.072 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:58:40.074 INFO 9 --- [Collect all tenants major compactions2,16514ed9faa53629,1381b904f8a740b7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:40.074 INFO 9 --- [Collect all tenants major compactions3,16514ed9faa53629,0ab3ee001071be8f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:40.074 INFO 9 --- [Collect all tenants major compactions1,16514ed9faa53629,2a94236d409dfbf2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:40.075 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:58:40.075 INFO 9 --- [Collect all tenants major compactions2,16514ed9faa53629,1381b904f8a740b7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:58:40.075 INFO 9 --- [Collect all tenants major compactions3,16514ed9faa53629,0ab3ee001071be8f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:58:40.076 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:58:40.076 INFO 9 --- [Collect all tenants major compactions1,16514ed9faa53629,2a94236d409dfbf2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:58:40.080 INFO 9 --- [Collect all tenants major compactions3,16514ed9faa53629,0ab3ee001071be8f] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:58:40.080 INFO 9 --- [Collect all tenants major compactions2,16514ed9faa53629,1381b904f8a740b7] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:58:40.080 INFO 9 --- [Collect all tenants major compactions1,16514ed9faa53629,2a94236d409dfbf2] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:58:40.081 INFO 9 --- [ocp-schedules-3,16514ed9faa53629,a0435bf5d2c22d4a] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:58:40.089 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:58:40.091 INFO 9 --- [ocp-schedules-9,fc46d59a04386d36,598b2a80d3e7ff8b] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:58:40.136 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:58:40.004816+08:00 2025-09-16 13:58:40.187 INFO 9 --- [ocp-async-5,bf3db7f32c603ce9,3a9123cdb6694f15] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:58:40.498 INFO 9 --- [ocp-schedules-7,29c2bbc976b01abf,5ffd173f26985f73] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache ended, seriesIdKeySize=16769 2025-09-16 13:58:40.636 INFO 9 --- [prometheus-minute-schedule-1,f67345c554cdbb5e,f519bf47682fef88] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:40.639 INFO 9 --- [prometheus-minute-schedule-1,f67345c554cdbb5e,f519bf47682fef88] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:40.807 WARN 9 --- [ocp-async-2,364b8a543ba99b49,b33bcf7bb89a6144] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:40.807 INFO 9 --- [ocp-async-4,f6a0a7a75bd6da58,ca6871ddd211c775] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:41.884 INFO 9 --- [ocp-schedules-29,7581c7fe10176636,12edc44f6f40652a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:58:41.890 WARN 9 --- [scanner-1383645-1,7581c7fe10176636,7c8b65dae3c9f008] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:58:41.899 INFO 9 --- [alarm-detect-20,7581c7fe10176636,f52b0b01d15258c9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 36, data is empty. 2025-09-16 13:58:41.901 INFO 9 --- [alarm-detect-19,7581c7fe10176636,43c2f56f5be3caf0] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 36, data is empty. 2025-09-16 13:58:41.901 INFO 9 --- [alarm-detect-15,7581c7fe10176636,143dc62e5af3a751] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 36, data is empty. 2025-09-16 13:58:41.914 INFO 9 --- [alarm-detect-20,7581c7fe10176636,d3203e07c8ea3b3a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 36, data is empty. 2025-09-16 13:58:42.558 INFO 9 --- [ocp-schedules-15,3f0c991f0b709351,3f0b33aa766ce0c2] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:58:42.558 INFO 9 --- [ocp-schedules-15,3f0c991f0b709351,3f0b33aa766ce0c2] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:58:42.582 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:42.583 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:42.593 INFO 9 --- [ocp-schedules-15,3f0c991f0b709351,3f0b33aa766ce0c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:42.594 INFO 9 --- [ocp-schedules-15,3f0c991f0b709351,3f0b33aa766ce0c2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:58:42.807 WARN 9 --- [ocp-async-5,c730860af7a563b6,eb0fa62fca078be3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:42.807 INFO 9 --- [ocp-async-6,93d8d26dbdd6130d,582a2b424d90e2ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:43.636 INFO 9 --- [prometheus-minute-schedule-1,b4a438352d09fc94,6899de42c8714469] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:43.640 INFO 9 --- [prometheus-minute-schedule-1,b4a438352d09fc94,6899de42c8714469] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:44.807 WARN 9 --- [ocp-async-8,838522a5909ccc62,72fae230fa139a17] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:44.807 INFO 9 --- [ocp-async-3,116842313e2cb4dd,1658b16f4b36b7ab] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:44.856 INFO 9 --- [ocp-schedules-8,b63ab99f3ea3e277,8441f18131e2e67b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:58:45.583 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:45.583 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:46.105 INFO 9 --- [ocp-schedules-13,5431184bcbc73d9d,a5a6fd03ee00ca2a] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:58:46.107 INFO 9 --- [ocp-schedules-13,5431184bcbc73d9d,a5a6fd03ee00ca2a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:46.152 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:58:46.153 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.155 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:58:46.185 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.186 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:58:46.209 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.209 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:58:46.232 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.232 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:58:46.237 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.238 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:58:46.261 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.262 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:58:46.282 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.283 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:58:46.288 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.288 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:58:46.312 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.312 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:58:46.334 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.335 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:58:46.353 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.354 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:58:46.355 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.356 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:58:46.357 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.358 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:58:46.358 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.359 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:58:46.360 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.361 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:58:46.361 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.362 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:58:46.377 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.378 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:58:46.379 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.380 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:58:46.380 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.381 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:58:46.396 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:58:46.398 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:58:46.425 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:58:46.426 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:46.427 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:58:46.458 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:58:46.458 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:58:46.458 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:58:46.458 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:58:46.458 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:58:46.458 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:58:46.460 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:58:46.460 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:58:46.460 INFO 9 --- [ocp-schedules-13,5431184bcbc73d9d,a5a6fd03ee00ca2a] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 13:58:46.636 INFO 9 --- [prometheus-minute-schedule-1,54b170123433c95b,98c0c19d934ae550] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:46.639 INFO 9 --- [prometheus-minute-schedule-1,54b170123433c95b,98c0c19d934ae550] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:46.807 WARN 9 --- [ocp-async-1,701ad0f7bb5d542b,f0756776fb471453] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:46.807 INFO 9 --- [ocp-async-10,f5d627e67fa56b78,767c27d4d1cace4c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 13:58:46,990 |-INFO in ReconfigureOnChangeTask(born:1758002146990) - Empty watch file list. Disabling 2025-09-16 13:58:47.362 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 13:58:47.362 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 13:58:47.365 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:58:47.365 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:58:47.365 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:58:47.365 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:58:47.368 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 13:58:47.368 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 13:58:47.368 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 13:58:47.368 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 13:58:47.385 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:58:47.390 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:58:47.390 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:58:47.390 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:58:47.390 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:58:47.390 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:58:47.394 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:58:47.657 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 13:58:47.931 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.56370364S 2025-09-16 13:58:47.931 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 13:58:47.984 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 13:58:47.984 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 13:58:48.013 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 13:58:48,026 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:58:48,027 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:58:48,027 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:58:48,027 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:58:48,028 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:58:48,028 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:58:48,026 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 13:58:48,027 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 13:58:48,027 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 13:58:48,027 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 13:58:48,028 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 13:58:48,028 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 13:58:48,028 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@2bf610ba - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 13:58:48,031 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 13:58:48,031 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 13:58:48,032 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 13:58:48,032 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@2bf610ba - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 13:58:48,034 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 13:58:48,034 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 13:58:48,034 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 13:58:48,034 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 13:58:48,034 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:48,034 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 13:58:48,034 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 13:58:48,034 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 13:58:48,035 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:58:48,035 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 13:58:48,035 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 13:58:48,035 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 13:58:48,035 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 13:58:48,035 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:58:48,035 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 13:58:48,035 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@461054186 - setting totalSizeCap to 10 GB 13:58:48,035 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@461054186 - Archive files will be limited to [100 MB] each. 13:58:48,035 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@461054186 - Will use gz compression 13:58:48,035 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@461054186 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 13:58:48,035 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@9380ff - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 13:58:48,035 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@9380ff - Roll-over at midnight. 13:58:48,035 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@9380ff - Setting initial period to Tue Sep 16 13:58:48 CST 2025 13:58:48,035 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@461054186 - Cleaning on start up 13:58:48,035 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 13:58:48,035 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 13:58:48,036 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 13:58:48,036 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 13:58:48,036 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:58:48,036 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 13:58:48,036 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 13:58:48,036 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 13:58:48,036 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 13:58:48,036 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 13:58:48,036 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 13:58:48,036 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1057786307 - setting totalSizeCap to 10 GB 13:58:48,036 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1057786307 - Archive files will be limited to [100 MB] each. 13:58:48,036 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1057786307 - Will use gz compression 13:58:48,036 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1057786307 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 13:58:48,036 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7d3282b8 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 13:58:48,036 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7d3282b8 - Roll-over at midnight. 13:58:48,036 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@7d3282b8 - Setting initial period to Tue Sep 16 13:58:29 CST 2025 13:58:48,037 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 13:58:48,037 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 13:58:48,037 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 13:58:48,037 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 13:58:48,037 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 13:58:48,037 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 13:58:48,037 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 13:58:48,037 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 13:58:48,037 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 13:58:48,037 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 13:58:48,037 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 13:58:48,037 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 13:58:48,037 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating INFO level on Logger[ROOT] onto the JUL framework 13:58:48,037 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 13:58:48,037 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 13:58:48,037 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 13:58:48,037 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 13:58:48,037 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@613a6199 - Registering current configuration as safe fallback point 13:58:48,039 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 13:58:48,041 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating INFO level on Logger[web] onto the JUL framework 13:58:48,041 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 13:58:48,041 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@189bd46d - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 13:58:48.042 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 13:58:48.042 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 13:58:48.042 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 13:58:48.042 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 13:58:48.042 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 13:58:48.042 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 13:58:48.049 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 13:58:48.136 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] o.s.boot.SpringApplication : Started application in 0.771 seconds (JVM running for 13303.18) 2025-09-16 13:58:48.136 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.771429823S 2025-09-16 13:58:48.386 INFO 9 --- [ocp-schedules-12,53a6a2e9be9bb30e,516d903f1fee7de7] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 13:58:48.583 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:48.584 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:48.807 WARN 9 --- [ocp-async-5,4209197c0bf1930b,1177de8416636b5f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:48.807 INFO 9 --- [ocp-async-7,1161e6c06480ee78,e234b358971f75b3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:49.230 INFO 9 --- [ocp-schedules-23,4bfb811ed09f56e5,ad1092a2ef2990bc] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:58:49.233 INFO 9 --- [ocp-schedules-23,4bfb811ed09f56e5,ad1092a2ef2990bc] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:58:49.237 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.238 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:49.239 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.240 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:49.241 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 13:58:49.254 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 13:58:49.267 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 13:58:49.267 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 13:58:49.267 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 13:58:49.267 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 13:58:49.267 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 13:58:49.270 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.270 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.270 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.270 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.270 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.271 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:49.271 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:49.271 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:49.271 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:49.272 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.272 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.272 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:49.272 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.272 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:58:49.272 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:58:49.272 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:58:49.273 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.273 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:58:49.273 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:49.274 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 13:58:49.294 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:56:30, start=2025-09-16T13:52:30, end=2025-09-16T13:55:00, updates=83, granule=120000ms, delay=240000ms 2025-09-16 13:58:49.294 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:56:30, start=2025-09-16T13:52:30, end=2025-09-16T13:55:00, updates=81, granule=120000ms, delay=240000ms 2025-09-16 13:58:49.298 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:56:30, start=2025-09-16T13:52:30, end=2025-09-16T13:55:00, updates=124, granule=120000ms, delay=240000ms 2025-09-16 13:58:49.298 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:56:30, start=2025-09-16T13:52:30, end=2025-09-16T13:55:00, updates=136, granule=120000ms, delay=240000ms 2025-09-16 13:58:49.299 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:56:30, target=2025-09-16T13:55:00, granule=120000ms, delay=90000ms) 2025-09-16 13:58:49.299 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:55:00, target=2025-09-16T13:47:30, granule=600000ms, delay=450000ms) 2025-09-16 13:58:49.299 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:56:30, target=2025-09-16T13:55:00, granule=120000ms, delay=90000ms) 2025-09-16 13:58:49.299 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:55:00, target=2025-09-16T13:47:30, granule=600000ms, delay=450000ms) 2025-09-16 13:58:49.307 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:56:30, target=2025-09-16T13:55:00, granule=120000ms, delay=90000ms) 2025-09-16 13:58:49.307 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:56:30, target=2025-09-16T13:55:00, granule=120000ms, delay=90000ms) 2025-09-16 13:58:49.307 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:55:00, target=2025-09-16T13:47:30, granule=600000ms, delay=450000ms) 2025-09-16 13:58:49.307 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:55:00, target=2025-09-16T13:47:30, granule=600000ms, delay=450000ms) 2025-09-16 13:58:49.308 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:56:30, start=2025-09-16T13:52:30, end=2025-09-16T13:55:00, updates=210, granule=120000ms, delay=240000ms 2025-09-16 13:58:49.312 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:56:30, target=2025-09-16T13:55:00, granule=120000ms, delay=90000ms) 2025-09-16 13:58:49.312 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:55:00, target=2025-09-16T13:47:30, granule=600000ms, delay=450000ms) 2025-09-16 13:58:49.312 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=71ms, period=120000ms 2025-09-16 13:58:49.636 INFO 9 --- [prometheus-minute-schedule-1,31ce4f16d3f77950,fc71b6b8ea57acab] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:49.639 INFO 9 --- [prometheus-minute-schedule-1,31ce4f16d3f77950,fc71b6b8ea57acab] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:50.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:58:50.004084+08:00, lastProcessTime=2025-09-16T13:58:40.004816+08:00 2025-09-16 13:58:50.113 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:58:50.004084+08:00 2025-09-16 13:58:50.187 INFO 9 --- [ocp-async-1,44d96dfd2d055cfc,55afe725b2e828ab] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:58:50.807 WARN 9 --- [ocp-async-9,446e127e433e95ef,9aeb9127f54906fe] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:50.807 INFO 9 --- [ocp-async-3,0d6eae3d5f7c4943,12fb241ad164183a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:51.584 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:51.585 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:51.917 INFO 9 --- [ocp-schedules-30,2a3eaa52781d8f3c,b73486132b5fc9a4] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:58:51.922 WARN 9 --- [scanner-1383802-1,2a3eaa52781d8f3c,eed84eb447d9a574] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:58:52.636 INFO 9 --- [prometheus-minute-schedule-1,9baaa80b194192f9,da0a04e93851b8ac] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:52.639 INFO 9 --- [prometheus-minute-schedule-1,9baaa80b194192f9,da0a04e93851b8ac] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:52.807 WARN 9 --- [ocp-async-1,fc193c8f7e02ae2e,0ce06e175c9d7c83] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:52.808 INFO 9 --- [ocp-async-1,19a5b2367e187c6e,be6db54a27bc902c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:54.585 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:54.586 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:54.741 INFO 9 --- [ocp-schedules-19,57e23e40d38ebea0,21f306ccf915ddee] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:58:54.747 INFO 9 --- [ocp-schedules-19,57e23e40d38ebea0,21f306ccf915ddee] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:58:54.747 INFO 9 --- [ocp-schedules-19,57e23e40d38ebea0,21f306ccf915ddee] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:58:54.808 WARN 9 --- [ocp-async-5,bf982b1fe13f9d0b,f546acbebee4e799] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:54.808 INFO 9 --- [ocp-async-7,a18312c305204ad0,9c6e3a8f321d896a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:54.860 INFO 9 --- [ocp-schedules-20,f7aa0bc0a9e2091a,a6898a5df4934ea2] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:58:55.636 INFO 9 --- [prometheus-minute-schedule-1,935922ad227f3acf,d9be0d3cf57c3372] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:55.640 INFO 9 --- [prometheus-minute-schedule-1,935922ad227f3acf,d9be0d3cf57c3372] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:56.808 WARN 9 --- [ocp-async-6,224e8430a5f83108,e9e101b5b3a1685d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:56.808 INFO 9 --- [ocp-async-8,4aeec05d0856dacc,440fe75e26597f4d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:57.586 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:58:57.587 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:58:58.636 INFO 9 --- [prometheus-minute-schedule-1,3c2934119fa40ecf,3fe8ddfbfa9f0205] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002340, interval=60 2025-09-16 13:58:58.639 INFO 9 --- [prometheus-minute-schedule-1,3c2934119fa40ecf,3fe8ddfbfa9f0205] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:58:58.808 WARN 9 --- [ocp-async-10,880ff93a8da51d23,7eed352d2ada6a3a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:58:58.808 INFO 9 --- [ocp-async-2,fee009b7fab95db9,885978e23d74f731] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:58:59.239 INFO 9 --- [ocp-schedules-16,2f77d63397f6a67b,de6470f9359fcee5] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:58:59.240 INFO 9 --- [ocp-schedules-16,2f77d63397f6a67b,de6470f9359fcee5] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:58:59.938 INFO 9 --- [ocp-schedules-13,c3ee2958eec37185,6469ebe37330298b] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:58:59.941 INFO 9 --- [ocp-schedules-4,e13263e560a74fe5,b49c910157d0281d] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:58:59.941 INFO 9 --- [ocp-schedules-1,d8158998bc01d8fc,824bcb6985439c87] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:58:59.942 INFO 9 --- [ocp-schedules-11,eef550e6fbb63d20,a85fd0922678aa08] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:58:59.943 INFO 9 --- [ocp-schedules-1,d8158998bc01d8fc,824bcb6985439c87] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:59.943 INFO 9 --- [ocp-schedules-4,e13263e560a74fe5,b49c910157d0281d] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:59.943 INFO 9 --- [ocp-schedules-11,eef550e6fbb63d20,a85fd0922678aa08] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:58:59.944 INFO 9 --- [ocp-schedules-11,eef550e6fbb63d20,a85fd0922678aa08] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:58:59.945 INFO 9 --- [ocp-schedules-18,f586c7675862955f,408f559c911b7764] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:58:59.945 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:58:59.945 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:58:59.945 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:58:59.945 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:58:59.945 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:58:59.945 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:58:59.946 INFO 9 --- [ocp-schedules-5,f6e796fc2de1aae0,2f09eb42cc0c091c] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:58:59.946 INFO 9 --- [host-check-agent-status1,f6e796fc2de1aae0,45eb1a95138dbe02] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:58:59.946 INFO 9 --- [host-check-agent-status2,f6e796fc2de1aae0,c3461e3b1e148514] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:58:59.946 INFO 9 --- [ocp-schedules-17,ef0859f6f4f0888c,098e1f2eec043465] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:58:59.946 INFO 9 --- [host-check-agent-status3,f6e796fc2de1aae0,0a0733f552774b66] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:58:59.946 INFO 9 --- [host-check-agent-status4,f6e796fc2de1aae0,f3638407ad70f07c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:58:59.946 INFO 9 --- [host-check-agent-status5,f6e796fc2de1aae0,6f021edbe27e0863] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:58:59.946 INFO 9 --- [host-check-agent-status6,f6e796fc2de1aae0,602be51c063311ed] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:58:59.946 INFO 9 --- [host-check-clockdiff1,ef0859f6f4f0888c,1859972a1b0d1bde] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:58:59.946 INFO 9 --- [host-check-clockdiff2,ef0859f6f4f0888c,062891b96edb302a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:58:59.946 INFO 9 --- [host-check-clockdiff3,ef0859f6f4f0888c,a74764032df4400d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:58:59.946 INFO 9 --- [host-check-clockdiff4,ef0859f6f4f0888c,c2c79fd86c2b05a7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:58:59.946 INFO 9 --- [host-check-clockdiff5,ef0859f6f4f0888c,745891a27e90edaf] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:58:59.946 INFO 9 --- [host-check-clockdiff6,ef0859f6f4f0888c,c9b629fef0133982] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:58:59.948 INFO 9 --- [ocp-schedules-30,a261b962961ee252,f7ec9ad037339f73] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:58:59.954 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:58:59.954 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:58:59.954 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:58:59.954 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:58:59.954 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:58:59.954 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:59.954 INFO 9 --- [host-check-clockdiff5,ef0859f6f4f0888c,745891a27e90edaf] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002339 -1 -1 , error= 2025-09-16 13:58:59.954 INFO 9 --- [host-check-clockdiff4,ef0859f6f4f0888c,c2c79fd86c2b05a7] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002339 -1 -1 , error= 2025-09-16 13:58:59.954 INFO 9 --- [host-check-clockdiff6,ef0859f6f4f0888c,c9b629fef0133982] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002339 -1 -1 , error= 2025-09-16 13:58:59.954 INFO 9 --- [host-check-clockdiff2,ef0859f6f4f0888c,062891b96edb302a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002339 -2 -2 , error= 2025-09-16 13:58:59.954 INFO 9 --- [host-check-clockdiff3,ef0859f6f4f0888c,a74764032df4400d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002339 -1 -1 , error= 2025-09-16 13:58:59.955 INFO 9 --- [host-check-agent-status1,f6e796fc2de1aae0,45eb1a95138dbe02] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:58:59.955 INFO 9 --- [host-check-clockdiff1,ef0859f6f4f0888c,1859972a1b0d1bde] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002339 -1 -1 , error= 2025-09-16 13:58:59.956 INFO 9 --- [host-check-agent-status6,f6e796fc2de1aae0,602be51c063311ed] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:58:59.956 INFO 9 --- [host-check-agent-status4,f6e796fc2de1aae0,f3638407ad70f07c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:58:59.956 INFO 9 --- [host-check-agent-status3,f6e796fc2de1aae0,0a0733f552774b66] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:58:59.956 INFO 9 --- [host-check-agent-status2,f6e796fc2de1aae0,c3461e3b1e148514] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:58:59.956 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:58:59.956 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:58:59.956 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:58:59.956 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:58:59.957 INFO 9 --- [host-check-agent-status5,f6e796fc2de1aae0,6f021edbe27e0863] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:58:59.957 INFO 9 --- [host-check-agent-status1,f6e796fc2de1aae0,45eb1a95138dbe02] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:58:59.957 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:58:59.957 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:59.957 INFO 9 --- [host-check-agent-status3,f6e796fc2de1aae0,0a0733f552774b66] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:58:59.957 INFO 9 --- [host-check-agent-status2,f6e796fc2de1aae0,c3461e3b1e148514] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:58:59.957 INFO 9 --- [host-check-agent-status6,f6e796fc2de1aae0,602be51c063311ed] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:58:59.972 INFO 9 --- [host-check-agent-status5,f6e796fc2de1aae0,6f021edbe27e0863] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:58:59.972 INFO 9 --- [host-check-agent-status4,f6e796fc2de1aae0,f3638407ad70f07c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:58:59.985 INFO 9 --- [host-check-agent-status1,f6e796fc2de1aae0,45eb1a95138dbe02] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-agent-status3,f6e796fc2de1aae0,0a0733f552774b66] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-agent-status2,f6e796fc2de1aae0,c3461e3b1e148514] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-agent-status6,f6e796fc2de1aae0,602be51c063311ed] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:58:59.986 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:58:59.987 INFO 9 --- [host-check-agent-status4,f6e796fc2de1aae0,f3638407ad70f07c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:58:59.987 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:58:59.987 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:58:59.986363786+08:00 2025-09-16 13:58:59.987 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:58:59.986259206+08:00 2025-09-16 13:58:59.987 INFO 9 --- [host-check-agent-status5,f6e796fc2de1aae0,6f021edbe27e0863] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:58:59.987+08:00 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:58:59.986914956+08:00 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:58:59.987+08:00 2025-09-16 13:58:59.988 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:58:59.987266043+08:00 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:58:59.988+08:00 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:58:59.987029762+08:00 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:58:59.987236603+08:00 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:58:59.988+08:00 2025-09-16 13:58:59.988 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:58:59.988+08:00 2025-09-16 13:58:59.989 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:58:59.988+08:00 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status1,f6e796fc2de1aae0,45eb1a95138dbe02] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status1,f6e796fc2de1aae0,45eb1a95138dbe02] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status1,f6e796fc2de1aae0,45eb1a95138dbe02] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status3,f6e796fc2de1aae0,0a0733f552774b66] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status3,f6e796fc2de1aae0,0a0733f552774b66] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status3,f6e796fc2de1aae0,0a0733f552774b66] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status4,f6e796fc2de1aae0,f3638407ad70f07c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status4,f6e796fc2de1aae0,f3638407ad70f07c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status4,f6e796fc2de1aae0,f3638407ad70f07c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status6,f6e796fc2de1aae0,602be51c063311ed] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status6,f6e796fc2de1aae0,602be51c063311ed] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:58:59.990 INFO 9 --- [host-check-agent-status6,f6e796fc2de1aae0,602be51c063311ed] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:58:59.991 INFO 9 --- [host-check-agent-status2,f6e796fc2de1aae0,c3461e3b1e148514] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:58:59.991 INFO 9 --- [host-check-agent-status2,f6e796fc2de1aae0,c3461e3b1e148514] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:58:59.991 INFO 9 --- [host-check-agent-status2,f6e796fc2de1aae0,c3461e3b1e148514] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:58:59.991 INFO 9 --- [host-check-agent-status5,f6e796fc2de1aae0,6f021edbe27e0863] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:58:59.991 INFO 9 --- [host-check-agent-status5,f6e796fc2de1aae0,6f021edbe27e0863] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:58:59.991 INFO 9 --- [host-check-agent-status5,f6e796fc2de1aae0,6f021edbe27e0863] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:58:59.993 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:58:59.993 INFO 9 --- [ocp-schedules-1,d8158998bc01d8fc,824bcb6985439c87] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:58:59.994 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:58:59.987+08:00 and status AVAILABLE 2025-09-16 13:58:59.995 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:58:59.988+08:00 and status AVAILABLE 2025-09-16 13:58:59.997 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:58:59.988+08:00 and status AVAILABLE 2025-09-16 13:58:59.997 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:58:59.997 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:58:59.987+08:00 and status AVAILABLE 2025-09-16 13:58:59.998 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:58:59.988+08:00 and status AVAILABLE 2025-09-16 13:58:59.998 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:58:59.999 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:58:59.999 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:59:00.000 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:58:59.988+08:00 and status AVAILABLE 2025-09-16 13:59:00.001 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:59:00.003 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:59:00.003 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:00.004 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:00.004 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:00.004 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:00.005 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:59:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:59:00.003612+08:00, lastProcessTime=2025-09-16T13:58:50.004084+08:00 2025-09-16 13:59:00.005 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:00.005 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:00.005 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:00.006 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:00.006 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:00.006 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:00.007 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:00.009 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:00.010 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:00.018 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:00.019 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:00.020 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:00.021 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:00.021 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:00.024 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:00.047 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:59:00.047 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:59:00.048 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:59:00.049 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:59:00.051 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:59:00.053 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:59:00.054 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:59:00.055 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:59:00.055 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:59:00.056 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:59:00.058 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:59:00.062 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:59:00.071 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:00.071 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:00.071 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:00.072 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:00.074 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:00.075 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:00.096 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:00.098 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:59:00.098 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:59:00.099 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:59:00.100 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:00.100 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:59:00.102 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:59:00.102 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:59:00.103 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:59:00.105 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:59:00.105 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:59:00.106 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:59:00.108 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:59:00.109 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:59:00.109 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:59:00.117 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:00.117 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:00.118 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:00.119 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:00.120 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:00.121 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:00.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:59:00.003612+08:00 2025-09-16 13:59:00.136 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:00.138 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:00.138 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:59:00.144 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:59:00.145 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:59:00.146 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:59:00.147 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:59:00.148 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:59:00.149 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:59:00.152 INFO 9 --- [host-check-host-status1,f586c7675862955f,d8d14cc862721383] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:59:00.152 INFO 9 --- [host-check-host-status3,f586c7675862955f,fbd015deec1d18f4] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:59:00.153 INFO 9 --- [host-check-host-status4,f586c7675862955f,ae4df1dc280d5f05] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:59:00.154 INFO 9 --- [host-check-host-status5,f586c7675862955f,fd774055e2bd82ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:59:00.155 INFO 9 --- [host-check-host-status2,f586c7675862955f,007e0c7b4b8ab4f5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:59:00.155 INFO 9 --- [host-check-host-status6,f586c7675862955f,3ea8b9e329076391] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:59:00.169 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:00.171 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:59:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:00.187 INFO 9 --- [ocp-async-7,e60b264ff6eec653,a2f0d6fba76a9242] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:59:00.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:00.211 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.211 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:00.224 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:00.240 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.240 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:00.253 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.253 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:00.268 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.268 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:00.281 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.281 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:00.296 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.296 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:00.310 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.310 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:00.325 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:00.338 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:00.340 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:00.340 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:59:00.345 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:59:00.349 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:59:00.352 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:00.353 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:59:00.426 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:59:00.440 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:00.445 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:00.445 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:59:00.460 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:59:00.460 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:59:00.460 INFO 9 --- [ocp-schedules-4,e13263e560a74fe5,b49c910157d0281d] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:59:00.587 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:00.587 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:00.808 WARN 9 --- [ocp-async-5,5c50500540fd5dc7,0232fd3820d8fddd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:00.808 INFO 9 --- [ocp-async-6,a279f1a91a7bfe10,c874f92269c310ea] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:00.864 INFO 9 --- [ocp-schedules-30,60e404e833923c36,732f6d7241015796] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:59:01.636 INFO 9 --- [prometheus-minute-schedule-1,427380a5a76a7c58,a0deeca1b1abe37a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:01.640 INFO 9 --- [prometheus-minute-schedule-1,427380a5a76a7c58,a0deeca1b1abe37a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:01.943 INFO 9 --- [ocp-schedules-3,5d0c0771d388fe8d,0bd62cd111182803] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:59:01.949 WARN 9 --- [scanner-1383939-1,5d0c0771d388fe8d,58e8f2eb5ca92890] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:59:01.959 INFO 9 --- [alarm-detect-15,5d0c0771d388fe8d,ec7ccf979a5921f6] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 37, data is empty. 2025-09-16 13:59:01.960 INFO 9 --- [alarm-detect-12,5d0c0771d388fe8d,671f7173d6ec554c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 37, data is empty. 2025-09-16 13:59:01.962 INFO 9 --- [alarm-detect-7,5d0c0771d388fe8d,1b59b44e47e3de07] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 37, data is empty. 2025-09-16 13:59:01.974 INFO 9 --- [alarm-detect-10,5d0c0771d388fe8d,d6af43c9606ad697] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 37, data is empty. 2025-09-16 13:59:02.808 WARN 9 --- [ocp-async-7,e92af8e8cf8a4fbb,4a70e29fbb88eb36] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:02.808 INFO 9 --- [ocp-async-8,10d4e848d91bb5fc,4fe1d54d219b811b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:03.587 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:03.588 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:04.636 INFO 9 --- [prometheus-minute-schedule-1,06afe93847d13aed,e82fb147c834f7f4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:04.639 INFO 9 --- [prometheus-minute-schedule-1,06afe93847d13aed,e82fb147c834f7f4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:04.808 WARN 9 --- [ocp-async-10,7a5e9439a9b4ac32,1d7facccd4bd1deb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:04.808 INFO 9 --- [ocp-async-2,7e5ae78147c92b3b,cde855ace27ed65e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:04.863 INFO 9 --- [ocp-schedules-25,c8e20d6266b624b4,a3e1cd6437cc3d92] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:59:06.588 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:06.589 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:06.808 WARN 9 --- [ocp-async-5,199f1aab36074bba,e8106e5f6864064b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:06.808 INFO 9 --- [ocp-async-4,f507d077db76976e,85dc2c56f91d95a4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:07.636 INFO 9 --- [prometheus-minute-schedule-1,6b4244af527996d6,b1ab30e09028514c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:07.639 INFO 9 --- [prometheus-minute-schedule-1,6b4244af527996d6,b1ab30e09028514c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:08.808 WARN 9 --- [ocp-async-7,69436eb7e09caa1f,ea6210a5509fb38a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:08.808 INFO 9 --- [ocp-async-9,efb550cfcb94537a,61f51d1605946125] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:09.189 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,bf00fb07042ae8ae,064f434e84ff5141] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=bf00fb07042ae8ae, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:59:09.190 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,bf00fb07042ae8ae,064f434e84ff5141] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=bf00fb07042ae8ae, duration=2 ms] 2025-09-16 13:59:09.245 INFO 9 --- [ocp-schedules-4,f0d232bdb58bb3f4,e7788deb5e89c440] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:59:09.247 INFO 9 --- [ocp-schedules-4,f0d232bdb58bb3f4,e7788deb5e89c440] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:59:09.589 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:09.589 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:10.002 INFO 9 --- [ocp-schedules-8,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:59:10.002 INFO 9 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:59:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:59:10.003571+08:00, lastProcessTime=2025-09-16T13:59:00.003612+08:00 2025-09-16 13:59:10.123 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:59:10.003571+08:00 2025-09-16 13:59:10.187 INFO 9 --- [ocp-async-2,916d4ee0fb2e40f2,eadc3cb51c4f8042] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:59:10.298 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 13:59:10.636 INFO 9 --- [prometheus-minute-schedule-1,158f154c57272741,e0a0ca4f76368a40] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:10.639 INFO 9 --- [prometheus-minute-schedule-1,158f154c57272741,e0a0ca4f76368a40] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:10.809 WARN 9 --- [ocp-async-3,cea226b494477259,242b06aa9d5c1391] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:10.809 INFO 9 --- [ocp-async-2,e50c3e5e8eb80592,da128ecfe9d8b37a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:11.747 INFO 9 --- [metric-archive-async-4,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002280, nodeCount=17, affectRows=17 2025-09-16 13:59:11.759 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002280, nodeCount=446, affectRows=446 2025-09-16 13:59:11.976 INFO 9 --- [ocp-schedules-14,6a48638150268ed5,0c93bae5d888fcb9] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:59:11.982 WARN 9 --- [scanner-1384977-1,6a48638150268ed5,9445f88ba47d815a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:59:12.590 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:12.590 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:12.783 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002280, nodeCount=1000, affectRows=1000 2025-09-16 13:59:12.786 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002280, nodeCount=1000, validCount=996 2025-09-16 13:59:12.809 WARN 9 --- [ocp-async-1,95d9f925a27009b8,ea005da6c9dfd37f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:12.809 INFO 9 --- [ocp-async-4,dea4bd5470aa132c,be08032c9dcf65a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:12.811 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002280, nodeCount=1000, affectRows=1000 2025-09-16 13:59:12.813 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002280, nodeCount=1000, validCount=998 2025-09-16 13:59:12.824 ERROR 9 --- [metric-archive-second-1,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952599621632-1758002220' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952599621632-1758002220' for key 'PRIMARY' 2025-09-16 13:59:13.636 INFO 9 --- [prometheus-minute-schedule-1,4b4075f671ba1414,7238e3f862c6ee64] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:13.639 INFO 9 --- [prometheus-minute-schedule-1,4b4075f671ba1414,7238e3f862c6ee64] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:14.080 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002280, nodeCount=1000, affectRows=1000 2025-09-16 13:59:14.083 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002280, nodeCount=991, validCount=957 2025-09-16 13:59:14.094 ERROR 9 --- [metric-archive-second-1,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952540901376-1758002220' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952540901376-1758002220' for key 'PRIMARY' 2025-09-16 13:59:14.749 INFO 9 --- [ocp-schedules-25,5cd863ca93825149,c9a844b00abc7d0e] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:59:14.754 INFO 9 --- [ocp-schedules-25,5cd863ca93825149,c9a844b00abc7d0e] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:59:14.754 INFO 9 --- [ocp-schedules-25,5cd863ca93825149,c9a844b00abc7d0e] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:59:14.809 WARN 9 --- [ocp-async-7,c55c1494b642f649,ce8db76eb6ad7eb2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:14.809 INFO 9 --- [ocp-async-6,0674cbe22167c9cb,a31ad270eb5009bf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:14.866 INFO 9 --- [ocp-schedules-2,8a4f9e60a5ddb2e1,026879dab35aec95] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:59:15.162 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002280, nodeCount=853, affectRows=853 2025-09-16 13:59:15.164 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002280, nodeCount=853, validCount=839 2025-09-16 13:59:15.590 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:15.591 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:16.636 INFO 9 --- [prometheus-minute-schedule-1,f7a980c90c7d885a,b3f47967e6d6d765] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:16.639 INFO 9 --- [prometheus-minute-schedule-1,f7a980c90c7d885a,b3f47967e6d6d765] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:16.809 WARN 9 --- [ocp-async-8,166e93667c6765ff,9c2744ef2b573aaa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:16.809 INFO 9 --- [ocp-async-3,1855bff6ca9b1330,3baa6d4d62b24a6b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:18.591 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:18.592 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:18.809 WARN 9 --- [ocp-async-2,2a625f1b77c202bc,6eb6ff6fef8cef19] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:18.809 INFO 9 --- [ocp-async-1,9575c8f8e8c466be,e665b811c2b07493] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:19.252 INFO 9 --- [ocp-schedules-20,5ade3ccd501fbbf5,796ad96b330143e3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:59:19.255 INFO 9 --- [ocp-schedules-20,5ade3ccd501fbbf5,796ad96b330143e3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:59:19.636 INFO 9 --- [prometheus-minute-schedule-1,e54ec552fcecaf6f,5bc63409fcb5dd44] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:19.639 INFO 9 --- [prometheus-minute-schedule-1,e54ec552fcecaf6f,5bc63409fcb5dd44] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:20.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:59:20.004220+08:00, lastProcessTime=2025-09-16T13:59:10.003571+08:00 2025-09-16 13:59:20.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:59:20.004220+08:00 2025-09-16 13:59:20.187 INFO 9 --- [ocp-async-8,3adc235e6257c425,ae962258e381527b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:59:20.636 INFO 9 --- [prometheus-cache-monitor1,2d0bf794cac51d20,2807f64c43c31b55] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":7203} 2025-09-16 13:59:20.636 INFO 9 --- [prometheus-cache-monitor1,2d0bf794cac51d20,2807f64c43c31b55] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 13:59:20.809 WARN 9 --- [ocp-async-9,d5fccc87c2496e01,83c527fdac1bae4f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:20.809 INFO 9 --- [ocp-async-4,09ef5ca11e0e03da,d06eadf9cc51e1a5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:21.592 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:21.592 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:22.003 INFO 9 --- [ocp-schedules-21,13cc26d075794f14,8c7e995c4a3c1865] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:59:22.008 WARN 9 --- [scanner-1385101-1,13cc26d075794f14,5077643160fc4d97] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:59:22.019 INFO 9 --- [alarm-detect-6,13cc26d075794f14,b6cd06db059f800d] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 37, data is empty. 2025-09-16 13:59:22.021 INFO 9 --- [alarm-detect-13,13cc26d075794f14,df76a6526c267a66] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 37, data is empty. 2025-09-16 13:59:22.021 INFO 9 --- [alarm-detect-16,13cc26d075794f14,a135c533ce5d4d45] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 37, data is empty. 2025-09-16 13:59:22.033 INFO 9 --- [alarm-detect-4,13cc26d075794f14,bd918e0e3cafa110] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 37, data is empty. 2025-09-16 13:59:22.636 INFO 9 --- [prometheus-minute-schedule-1,3e66abbe8ad47ac0,65fc1f59313879c9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:22.639 INFO 9 --- [prometheus-minute-schedule-1,3e66abbe8ad47ac0,65fc1f59313879c9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:22.809 WARN 9 --- [ocp-async-10,ca1a4b73ab6ae817,5e9c9e4cc15752ca] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:22.809 INFO 9 --- [ocp-async-6,d6b6b7d5ab08d377,75a7625e7401c73a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:24.118 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.123 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, 2025-09-16 13:59:24.127 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.130 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.133 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.136 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.139 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.142 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.145 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.148 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.159 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.170 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.180 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.190 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:24.043, end=2025-09-16T13:58:24.115} 2025-09-16 13:59:24.190 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2025-09-16 13:59:24.592 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:24.593 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:24.809 WARN 9 --- [ocp-async-5,d06adaa1fe4b1118,b5c746e112619049] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:24.809 INFO 9 --- [ocp-async-3,1064fee1fd400b25,c335f0dd6ef3ddef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:24.869 INFO 9 --- [ocp-schedules-14,faa8a2d902f586b3,debbcecb7c33a8ba] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:59:25.636 INFO 9 --- [prometheus-minute-schedule-1,469f78f3b862bb48,d599dc77aebdedac] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:25.639 INFO 9 --- [prometheus-minute-schedule-1,469f78f3b862bb48,d599dc77aebdedac] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:26.810 WARN 9 --- [ocp-async-9,dad720528278f88e,2e73e306490ac924] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:26.810 INFO 9 --- [ocp-async-7,af6f79ef4c25ec98,44e0319cc49cefa0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:27.593 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:27.594 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:28.230 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.234 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, 2025-09-16 13:59:28.238 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.241 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 1 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.251 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.255 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 1 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.267 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.271 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.275 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 2 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.282 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.286 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 2 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.298 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.311 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.311 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION is disabled or lacking of config 2025-09-16 13:59:28.323 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.335 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 7 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.397 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:53:28.084, end=2025-09-16T13:58:28.228} 2025-09-16 13:59:28.397 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 7 dubious sqls 2025-09-16 13:59:28.636 INFO 9 --- [prometheus-minute-schedule-1,e7c242ec1f59c351,7d612c0625a5a062] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:28.640 INFO 9 --- [prometheus-minute-schedule-1,e7c242ec1f59c351,7d612c0625a5a062] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:28.810 WARN 9 --- [ocp-async-10,9e5cfe3cebba4435,eb1c846206862618] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:28.810 INFO 9 --- [ocp-async-4,a042dd3e22c2ac5c,11aef46e8fd90cd1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:29.259 INFO 9 --- [ocp-schedules-16,63b0b00fa305ddf8,da61b162e58e7093] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:59:29.261 INFO 9 --- [ocp-schedules-16,63b0b00fa305ddf8,da61b162e58e7093] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:59:29.938 INFO 9 --- [ocp-schedules-15,f9da549efac6f5cd,5fe336330880daeb] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:59:29.941 INFO 9 --- [ocp-schedules-23,13e1bf7e98ed015b,7855d49cdff63335] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:59:29.941 INFO 9 --- [ocp-schedules-20,e18f4bfbb6747800,261676c60dac8233] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:59:29.942 INFO 9 --- [ocp-schedules-29,6c72ea09b1dab321,05f9ea9dd0b25f66] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:59:29.943 INFO 9 --- [ocp-schedules-20,e18f4bfbb6747800,261676c60dac8233] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:29.943 INFO 9 --- [ocp-schedules-23,13e1bf7e98ed015b,7855d49cdff63335] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:29.943 INFO 9 --- [ocp-schedules-29,6c72ea09b1dab321,05f9ea9dd0b25f66] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:29.944 INFO 9 --- [ocp-schedules-29,6c72ea09b1dab321,05f9ea9dd0b25f66] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:59:29.944 INFO 9 --- [ocp-schedules-7,f144bece876155df,27117dadc5ee7bee] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:59:29.945 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [ocp-schedules-15,767d7c5cdd39b4e1,b9a80fd86e3c49f4] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:59:29.945 INFO 9 --- [host-check-agent-status1,767d7c5cdd39b4e1,70e1ed45cdce9851] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-agent-status2,767d7c5cdd39b4e1,22a8d8c64947789d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-agent-status3,767d7c5cdd39b4e1,abae5d746bc6e921] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-agent-status4,767d7c5cdd39b4e1,5f4dc997fa8f5831] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-agent-status5,767d7c5cdd39b4e1,d8d054f1cf0bbe47] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:59:29.945 INFO 9 --- [host-check-agent-status6,767d7c5cdd39b4e1,e8897e513475520b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:59:29.946 INFO 9 --- [ocp-schedules-4,741d358d1432f398,b2fef4ab257ad8a7] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:59:29.946 INFO 9 --- [host-check-clockdiff1,741d358d1432f398,c0ed3c28bc665039] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:59:29.946 INFO 9 --- [host-check-clockdiff2,741d358d1432f398,c35223ad04bfbaed] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:59:29.946 INFO 9 --- [host-check-clockdiff3,741d358d1432f398,fac3ff864157eff0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:59:29.946 INFO 9 --- [host-check-clockdiff4,741d358d1432f398,aced376eae10151b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:59:29.946 INFO 9 --- [host-check-clockdiff5,741d358d1432f398,93845b1549db6104] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:59:29.946 INFO 9 --- [host-check-clockdiff6,741d358d1432f398,f064d3ee796b6136] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:59:29.950 INFO 9 --- [ocp-schedules-6,feb8c34aea9d8dd4,7dbb7f370b981eb6] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:59:29.951 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:29.953 INFO 9 --- [host-check-clockdiff1,741d358d1432f398,c0ed3c28bc665039] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002369 -1 -1 , error= 2025-09-16 13:59:29.954 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:29.954 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:29.954 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:29.954 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:29.954 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:29.954 INFO 9 --- [host-check-agent-status4,767d7c5cdd39b4e1,5f4dc997fa8f5831] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:29.954 INFO 9 --- [host-check-agent-status1,767d7c5cdd39b4e1,70e1ed45cdce9851] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:29.955 INFO 9 --- [host-check-agent-status2,767d7c5cdd39b4e1,22a8d8c64947789d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:29.955 INFO 9 --- [host-check-agent-status5,767d7c5cdd39b4e1,d8d054f1cf0bbe47] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:29.955 INFO 9 --- [host-check-agent-status3,767d7c5cdd39b4e1,abae5d746bc6e921] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:29.955 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:29.955 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:29.955 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:29.955 INFO 9 --- [host-check-agent-status4,767d7c5cdd39b4e1,5f4dc997fa8f5831] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:29.955 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:29.955 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:29.955 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:29.955 INFO 9 --- [host-check-agent-status1,767d7c5cdd39b4e1,70e1ed45cdce9851] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:29.956 INFO 9 --- [host-check-agent-status6,767d7c5cdd39b4e1,e8897e513475520b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:29.956 INFO 9 --- [host-check-agent-status2,767d7c5cdd39b4e1,22a8d8c64947789d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:29.956 INFO 9 --- [host-check-agent-status5,767d7c5cdd39b4e1,d8d054f1cf0bbe47] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:29.956 INFO 9 --- [host-check-agent-status3,767d7c5cdd39b4e1,abae5d746bc6e921] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:29.957 INFO 9 --- [host-check-agent-status6,767d7c5cdd39b4e1,e8897e513475520b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:29.962 INFO 9 --- [ocp-schedules-21,334888ebfe4d5629,944f66c3cfac2f5f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 13:59:29.963 INFO 9 --- [ocp-schedules-17,2c3f1dc06ec964f2,39289ec4717fafb7] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 13:59:29.967 INFO 9 --- [ocp-schedules-21,334888ebfe4d5629,944f66c3cfac2f5f] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 13:59:29.968 INFO 9 --- [ocp-schedules-17,2c3f1dc06ec964f2,39289ec4717fafb7] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 13:59:29.970 INFO 9 --- [host-check-agent-status4,767d7c5cdd39b4e1,5f4dc997fa8f5831] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:59:29.970 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:59:29.970 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:59:29.970 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:59:29.970 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:59:29.971 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:59:29.971 INFO 9 --- [host-check-agent-status1,767d7c5cdd39b4e1,70e1ed45cdce9851] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:59:29.971 INFO 9 --- [host-check-agent-status5,767d7c5cdd39b4e1,d8d054f1cf0bbe47] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:59:29.973 INFO 9 --- [host-check-agent-status3,767d7c5cdd39b4e1,abae5d746bc6e921] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:59:29.973 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:59:29.973 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:59:29.972120078+08:00 2025-09-16 13:59:29.973 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:59:29.972116647+08:00 2025-09-16 13:59:29.973 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:59:29.972538213+08:00 2025-09-16 13:59:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:29.973 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:59:29.972537627+08:00 2025-09-16 13:59:29.974 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:59:29.972186718+08:00 2025-09-16 13:59:29.974 INFO 9 --- [host-check-agent-status2,767d7c5cdd39b4e1,22a8d8c64947789d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:59:29.974 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:59:29.973+08:00 2025-09-16 13:59:29.974 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:59:29.973+08:00 2025-09-16 13:59:29.974 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:59:29.973+08:00 2025-09-16 13:59:29.974 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:59:29.973+08:00 2025-09-16 13:59:29.974 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:59:29.974+08:00 2025-09-16 13:59:29.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:59:29.974 INFO 9 --- [host-check-agent-status6,767d7c5cdd39b4e1,e8897e513475520b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:59:29.975 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:59:29.974367949+08:00 2025-09-16 13:59:29.975 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:59:29.973+08:00 and status AVAILABLE 2025-09-16 13:59:29.975 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:59:29.975+08:00 2025-09-16 13:59:29.975 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:59:29.973+08:00 and status AVAILABLE 2025-09-16 13:59:29.975 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:59:29.973+08:00 and status AVAILABLE 2025-09-16 13:59:29.975 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:59:29.973+08:00 and status AVAILABLE 2025-09-16 13:59:29.976 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:59:29.974+08:00 and status AVAILABLE 2025-09-16 13:59:29.976 INFO 9 --- [host-check-agent-status4,767d7c5cdd39b4e1,5f4dc997fa8f5831] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:59:29.976 INFO 9 --- [host-check-agent-status4,767d7c5cdd39b4e1,5f4dc997fa8f5831] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:59:29.976 INFO 9 --- [host-check-agent-status4,767d7c5cdd39b4e1,5f4dc997fa8f5831] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:59:29.976 INFO 9 --- [host-check-agent-status2,767d7c5cdd39b4e1,22a8d8c64947789d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status2,767d7c5cdd39b4e1,22a8d8c64947789d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status2,767d7c5cdd39b4e1,22a8d8c64947789d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status1,767d7c5cdd39b4e1,70e1ed45cdce9851] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status1,767d7c5cdd39b4e1,70e1ed45cdce9851] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status1,767d7c5cdd39b4e1,70e1ed45cdce9851] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status3,767d7c5cdd39b4e1,abae5d746bc6e921] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status3,767d7c5cdd39b4e1,abae5d746bc6e921] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status3,767d7c5cdd39b4e1,abae5d746bc6e921] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status5,767d7c5cdd39b4e1,d8d054f1cf0bbe47] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status5,767d7c5cdd39b4e1,d8d054f1cf0bbe47] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:59:29.977 INFO 9 --- [host-check-agent-status5,767d7c5cdd39b4e1,d8d054f1cf0bbe47] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:59:29.977 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:59:29.975+08:00 and status AVAILABLE 2025-09-16 13:59:29.978 INFO 9 --- [host-check-agent-status6,767d7c5cdd39b4e1,e8897e513475520b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:59:29.978 INFO 9 --- [host-check-agent-status6,767d7c5cdd39b4e1,e8897e513475520b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:59:29.978 INFO 9 --- [host-check-agent-status6,767d7c5cdd39b4e1,e8897e513475520b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:59:29.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:59:29.980 INFO 9 --- [ocp-schedules-20,e18f4bfbb6747800,261676c60dac8233] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:59:29.980 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:59:29.980 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:59:29.980 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:59:29.980 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:59:29.980 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:59:29.981 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:59:29.986 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:29.986 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:29.986 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:29.986 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:29.986 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:29.986 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:29.987 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:29.987 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:29.987 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:29.987 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:29.987 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:29.987 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:59:30.001 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:30.001 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:30.001 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:30.001 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:30.001 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:30.001 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:59:30.003925+08:00, lastProcessTime=2025-09-16T13:59:20.004220+08:00 2025-09-16 13:59:30.028 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 13:59:30.028 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 13:59:30.029 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 13:59:30.029 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 13:59:30.029 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 13:59:30.034 INFO 9 --- [ocp-schedules-25,297bec500104c322,1267cc302de2a8c8] c.o.o.a.service.OcpAlarmInspectService : delete inactive alarm event count 0 2025-09-16 13:59:30.034 INFO 9 --- [ocp-schedules-25,297bec500104c322,1267cc302de2a8c8] c.o.o.a.service.OcpAlarmInspectService : deleteInactiveAlarmEvents count 0 2025-09-16 13:59:30.035 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 13:59:30.035 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 13:59:30.035 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 13:59:30.035 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 13:59:30.035 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 13:59:30.035 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 13:59:30.041 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 13:59:30.047 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:30.049 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:30.049 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:30.049 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:30.049 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:30.053 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 13:59:30.055 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:30.056 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:30.057 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 13:59:30.075 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 13:59:30.076 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 13:59:30.077 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 13:59:30.077 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 13:59:30.078 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 13:59:30.081 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 13:59:30.082 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 13:59:30.083 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 13:59:30.083 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 13:59:30.084 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 13:59:30.084 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 13:59:30.088 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 13:59:30.093 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:30.094 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:30.095 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:59:30.095 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:30.096 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:30.096 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:30.097 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:30.097 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:30.099 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 13:59:30.101 INFO 9 --- [prometheus-second-schedule-1,d417a01b53879c65,585f774e6a8d46d5] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 13:59:30.123 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 13:59:30.124 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 13:59:30.124 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 13:59:30.124 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 13:59:30.125 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:30.126 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 13:59:30.127 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 13:59:30.128 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:30.128 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 13:59:30.130 INFO 9 --- [host-check-host-status3,f144bece876155df,7988401aaedeac37] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 13:59:30.131 INFO 9 --- [host-check-host-status5,f144bece876155df,9825f035022606f6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 13:59:30.131 INFO 9 --- [host-check-host-status2,f144bece876155df,0f3e608693120d5c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 13:59:30.131 INFO 9 --- [host-check-host-status4,f144bece876155df,fa604e2bc4fb0fb8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 13:59:30.132 INFO 9 --- [host-check-host-status1,f144bece876155df,02c224f71747091d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 13:59:30.135 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:59:30.003925+08:00 2025-09-16 13:59:30.135 INFO 9 --- [host-check-host-status6,f144bece876155df,aa8de687599cb3c7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 13:59:30.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:30.158 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.158 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:30.187 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.187 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:30.187 INFO 9 --- [ocp-async-7,00de9fe90e7a11c8,42508cc1f84676b3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:59:30.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.201 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:30.216 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.216 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:30.229 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.229 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:30.243 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.243 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 13:59:30.257 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.257 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 13:59:30.274 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 13:59:30.280 INFO 9 --- [ocp-schedules-18,b507aeaf4e4912ef,6a3a5cae85f3d956] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 13:59:30.281 INFO 9 --- [ocp-schedules-18,b507aeaf4e4912ef,6a3a5cae85f3d956] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:30.281 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 13:59:30.281 INFO 9 --- [ocp-schedules-18,b507aeaf4e4912ef,6a3a5cae85f3d956] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:59:30.286 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:30.288 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:30.289 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:59:30.294 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 13:59:30.297 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 13:59:30.300 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:30.301 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:30.314 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 13:59:30.374 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 13:59:30.388 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:30.389 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:30.390 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 13:59:30.404 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:59:30.404 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 13:59:30.404 INFO 9 --- [ocp-schedules-23,13e1bf7e98ed015b,7855d49cdff63335] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:59:30.411 INFO 9 --- [ocp-schedules-28,0d7ae6ac853c74f5,3f6925d427bf4883] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 13:59:30.594 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:30.594 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:30.600 INFO 9 --- [ocp-schedules-2,74a37f7cad3b9133,313ac22ac12db5fb] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 13:59:30.602 INFO 9 --- [ocp-schedules-2,74a37f7cad3b9133,313ac22ac12db5fb] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 13:59:30.602 INFO 9 --- [ocp-schedules-2,74a37f7cad3b9133,313ac22ac12db5fb] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 13:59:30.810 WARN 9 --- [ocp-async-9,9e90a76ea9254f77,944060039a032f92] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:30.810 INFO 9 --- [ocp-async-3,e3f14697be61c43a,7796182d55a96c19] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:30.866 INFO 9 --- [ocp-schedules-25,29754a329488ffc2,a7ffe2472b605a79] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 13:59:30.889 INFO 9 --- [host-check-clockdiff6,741d358d1432f398,f064d3ee796b6136] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002370 -2 -2 , error= 2025-09-16 13:59:30.890 INFO 9 --- [host-check-clockdiff2,741d358d1432f398,c35223ad04bfbaed] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002370 -2 -2 , error= 2025-09-16 13:59:30.890 INFO 9 --- [host-check-clockdiff3,741d358d1432f398,fac3ff864157eff0] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002370 -2 -2 , error= 2025-09-16 13:59:30.994 INFO 9 --- [ocp-schedules-9,c79b7b0d5c17de83,e44d74a4aa0105a2] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 13:59:30.994 INFO 9 --- [ocp-schedules-9,c79b7b0d5c17de83,e44d74a4aa0105a2] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 13:59:31.500 INFO 9 --- [ocp-schedules-22,c162c3c46cf01fdd,764cb86c2b8876bc] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 13:59:31.500 INFO 9 --- [ocp-schedules-22,c162c3c46cf01fdd,764cb86c2b8876bc] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002371 2025-09-16 13:59:31.502 INFO 9 --- [ocp-schedules-22,c162c3c46cf01fdd,764cb86c2b8876bc] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 13:59:31.636 INFO 9 --- [prometheus-minute-schedule-1,5584ba8fee67ca96,ec6e6e15d4cc6769] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:31.639 INFO 9 --- [prometheus-minute-schedule-1,5584ba8fee67ca96,ec6e6e15d4cc6769] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:31.672 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2025-09-16 13:59:31.672 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2025-09-16 13:59:31.675 INFO 9 --- [ocp-schedules-18,3c5b63b1c49ec9f5,93fe889d84fe467d] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 13:59:31.675 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2025-09-16 13:59:31.675 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: binlogQueryCache 2025-09-16 13:59:31.675 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.c.cache.helper.BinlogQueryCache : Init binlog cache. 2025-09-16 13:59:31.681 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.c.cache.helper.BinlogQueryCache : Finish init binlog cache. 2025-09-16 13:59:31.681 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2025-09-16 13:59:31.681 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2025-09-16 13:59:31.689 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2025-09-16 13:59:31.689 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2025-09-16 13:59:31.689 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2025-09-16 13:59:31.692 INFO 9 --- [ocp-schedules-26,3113219085270ac7,e34f169639f05d1e] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2025-09-16 13:59:31.711 INFO 9 --- [ocp-schedules-23,5644d895d8001f16,f87c13f4fc07f443] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 13:59:31.711 INFO 9 --- [ocp-schedules-23,5644d895d8001f16,f87c13f4fc07f443] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 13:59:31.714 INFO 9 --- [ocp-schedules-23,5644d895d8001f16,f87c13f4fc07f443] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 13:59:31.714 INFO 9 --- [ocp-schedules-23,5644d895d8001f16,f87c13f4fc07f443] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 13:59:31.716 INFO 9 --- [ocp-schedules-23,5644d895d8001f16,f87c13f4fc07f443] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 13:59:31.716 INFO 9 --- [ocp-schedules-23,5644d895d8001f16,f87c13f4fc07f443] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 13:59:31.732 INFO 9 --- [ocp-schedules-28,83ef8d436cf70dc7,212ccc01b7e1975d] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 13:59:31.732 INFO 9 --- [host-check-clockdiff4,741d358d1432f398,aced376eae10151b] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002371 -1 -1 , error= 2025-09-16 13:59:31.732 INFO 9 --- [host-check-clockdiff5,741d358d1432f398,93845b1549db6104] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002371 -1 -1 , error= 2025-09-16 13:59:32.035 INFO 9 --- [ocp-schedules-15,c2116f70534fc5c4,f633a73ba6fe8499] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:59:32.040 WARN 9 --- [scanner-1385265-1,c2116f70534fc5c4,875501286c613ab6] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:59:32.810 WARN 9 --- [ocp-async-10,87aef923d648f8f1,1f12d641af13a8ce] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:32.810 INFO 9 --- [ocp-async-8,b77590fe7518e6dd,60972b9b32b46f42] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:33.495 INFO 9 --- [ocp-schedules-6,c1ed4053970f35a6,7ac1c1d4ed6c7d4d] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 13:59:33.594 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:33.595 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:33.633 INFO 9 --- [ocp-schedules-29,0ad473cd7f4b1973,beece93902cc4a99] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T13:59:33.633+08:00, clusters=[1] 2025-09-16 13:59:33.635 INFO 9 --- [ocp-schedules-29,0ad473cd7f4b1973,beece93902cc4a99] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 13:59:34.203 INFO 9 --- [ocp-schedules-11,93a14fae53134297,00aa7ab715b7f1c2] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 13:59:34.203 INFO 9 --- [ocp-schedules-11,93a14fae53134297,00aa7ab715b7f1c2] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 13:59:34.206 INFO 9 --- [ocp-schedules-11,93a14fae53134297,00aa7ab715b7f1c2] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 13:59:34.221 INFO 9 --- [ocp-schedules-11,93a14fae53134297,00aa7ab715b7f1c2] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 13:59:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 13:59:34.636 INFO 9 --- [prometheus-minute-schedule-1,f1ffc0925e619f2a,4f20d2efcb2d2461] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:34.639 INFO 9 --- [prometheus-minute-schedule-1,f1ffc0925e619f2a,4f20d2efcb2d2461] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:34.755 INFO 9 --- [ocp-schedules-2,2fb80e75705e7588,a968dbbfa029e9b2] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:59:34.760 INFO 9 --- [ocp-schedules-2,2fb80e75705e7588,a968dbbfa029e9b2] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:59:34.760 INFO 9 --- [ocp-schedules-2,2fb80e75705e7588,a968dbbfa029e9b2] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:59:34.810 WARN 9 --- [ocp-async-4,707107b448ccc68f,96a1c7fa7a8356ff] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:34.810 INFO 9 --- [ocp-async-4,94c14152430a84ca,adc512aff8d0f690] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:34.872 INFO 9 --- [ocp-schedules-6,fe6e7cf0372908ea,42330a0d8ffee0a5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:59:35.782 INFO 9 --- [ocp-schedules-13,eb68eebd9fd9fb0d,5cfd0ae8eedeb274] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T13:59:35.782+08:00, clusters=[1] 2025-09-16 13:59:35.792 INFO 9 --- [ocp-schedules-13,eb68eebd9fd9fb0d,5cfd0ae8eedeb274] c.o.o.p.s.i.alarm.SlowSqlDataSource : query SlowSqlData of obCluster zhengqi, exclude result is empty. 2025-09-16 13:59:36.595 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:36.596 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:36.810 WARN 9 --- [ocp-async-1,84bee7056401d323,4f495a5ec7c64d37] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:36.810 INFO 9 --- [ocp-async-1,47736aa8eaee6ac7,615263b2573f334d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:37.636 INFO 9 --- [prometheus-minute-schedule-1,e49a31acdba2bbc2,7987377770b7fbdf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:37.639 INFO 9 --- [prometheus-minute-schedule-1,e49a31acdba2bbc2,7987377770b7fbdf] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:37.980 INFO 9 --- [ocp-schedules-6,12b18df498f76860,bbfefa291df15af4] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 13:59:37.982 INFO 9 --- [ocp-schedules-6,12b18df498f76860,bbfefa291df15af4] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:38.002 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:38.003 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 13:59:38.016 INFO 9 --- [ocp-schedules-6,12b18df498f76860,bbfefa291df15af4] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 13:59:38.810 WARN 9 --- [ocp-async-3,f78a56a64e7647b0,390c68a290e40a6c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:38.810 INFO 9 --- [ocp-async-10,2b58c1aded751f75,98bf4b29791c4337] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:39.266 INFO 9 --- [ocp-schedules-29,03a4b21a068b27ad,146afb10a14d819a] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:59:39.268 INFO 9 --- [ocp-schedules-29,03a4b21a068b27ad,146afb10a14d819a] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:59:39.596 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:39.596 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:40.002 INFO 9 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 13:59:40.003 INFO 9 --- [ocp-schedules-10,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 13:59:40.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:59:40.003267+08:00, lastProcessTime=2025-09-16T13:59:30.003925+08:00 2025-09-16 13:59:40.081 INFO 9 --- [ocp-schedules-18,3d0ed35bee2a2ae1,9f9a581740799023] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 13:59:40.081 INFO 9 --- [ocp-schedules-18,3d0ed35bee2a2ae1,9f9a581740799023] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 13:59:40.094 INFO 9 --- [ocp-schedules-7,0cefee71ea9d0f96,ba7ab38e1532f654] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:59:40.094 INFO 9 --- [ocp-schedules-7,0cefee71ea9d0f96,ba7ab38e1532f654] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 13:59:40.095 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 13:59:40.095 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 13:59:40.095 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 13:59:40.095 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 13:59:40.097 INFO 9 --- [Collect all tenants major compactions3,3d0ed35bee2a2ae1,dc8011081608c6a1] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 13:59:40.097 INFO 9 --- [Collect all tenants major compactions2,3d0ed35bee2a2ae1,e0c9c88b9ac8444c] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:59:40.098 INFO 9 --- [Collect all tenants major compactions1,3d0ed35bee2a2ae1,af1e1c42bcead2d9] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 13:59:40.098 INFO 9 --- [ocp-schedules-7,0cefee71ea9d0f96,ba7ab38e1532f654] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:40.098 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:40.098 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:40.098 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:40.099 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:40.099 INFO 9 --- [ocp-schedules-7,0cefee71ea9d0f96,ba7ab38e1532f654] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:40.099 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:40.099 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:40.099 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:40.100 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:40.113 INFO 9 --- [ocp-schedules-7,0cefee71ea9d0f96,ba7ab38e1532f654] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 13:59:40.113 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 13:59:40.113 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 13:59:40.114 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 13:59:40.115 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 13:59:40.116 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 13:59:40.118 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:40.119 INFO 9 --- [Collect all tenants major compactions2,3d0ed35bee2a2ae1,e0c9c88b9ac8444c] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:40.119 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:59:40.003267+08:00 2025-09-16 13:59:40.119 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:40.120 INFO 9 --- [Collect all tenants major compactions3,3d0ed35bee2a2ae1,dc8011081608c6a1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:40.120 INFO 9 --- [Collect all tenants major compactions2,3d0ed35bee2a2ae1,e0c9c88b9ac8444c] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 13:59:40.121 INFO 9 --- [Collect all tenants major compactions1,3d0ed35bee2a2ae1,af1e1c42bcead2d9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:40.121 INFO 9 --- [Collect all tenants major compactions3,3d0ed35bee2a2ae1,dc8011081608c6a1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 13:59:40.122 INFO 9 --- [Collect all tenants major compactions1,3d0ed35bee2a2ae1,af1e1c42bcead2d9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 13:59:40.126 INFO 9 --- [Collect all tenants major compactions3,3d0ed35bee2a2ae1,dc8011081608c6a1] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:59:40.127 INFO 9 --- [Collect all tenants major compactions1,3d0ed35bee2a2ae1,af1e1c42bcead2d9] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 13:59:40.132 INFO 9 --- [Collect all tenants major compactions2,3d0ed35bee2a2ae1,e0c9c88b9ac8444c] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 13:59:40.132 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 13:59:40.133 INFO 9 --- [ocp-schedules-18,3d0ed35bee2a2ae1,9f9a581740799023] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 13:59:40.134 INFO 9 --- [ocp-schedules-7,0cefee71ea9d0f96,ba7ab38e1532f654] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 13:59:40.187 INFO 9 --- [ocp-async-9,78219ee5e085b7ed,9a23df6e6ffe4971] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:59:40.636 INFO 9 --- [prometheus-minute-schedule-1,6a8b0de6b6d1ce08,a0eba98a60d855f4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:40.639 INFO 9 --- [prometheus-minute-schedule-1,6a8b0de6b6d1ce08,a0eba98a60d855f4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:40.810 WARN 9 --- [ocp-async-4,c7c6320d5b6da85b,95ba884a2171fbc4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:40.810 INFO 9 --- [ocp-async-2,74f1bebbc52e6201,89b4297fad38192f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:41.346 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:55:41.19, end=2025-09-16T13:57:41.344} 2025-09-16 13:59:41.349 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false 2025-09-16 13:59:41.350 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:59:41.352 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 1 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:55:41.19, end=2025-09-16T13:57:41.344},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:59:41.359 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:59:41.359 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:59:41.402 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915981402000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=370B05A5B9466AB45BBF52FCEB6743B6, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:59:41.402Z, endTime=2025-09-16T05:57:41.344Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:59:41.406 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915981406000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=5F69704287C33EE3564EB4EBEDBD28A6, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:59:41.406Z, endTime=2025-09-16T05:57:41.344Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:59:41.407 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757915981407000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=E9E2014C8CE705871C555597A6A32456, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T05:59:41.407Z, endTime=2025-09-16T05:57:41.344Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 13:59:41.410 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 1 2025-09-16 13:59:41.410 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:59:41.413 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 0 2025-09-16 13:59:41.413 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:59:41.413 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 0 2025-09-16 13:59:41.413 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 13:59:41.425 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:59:41.425 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=370B05A5B9466AB45BBF52FCEB6743B6, sqlIdList=null, dynamicSql=false) 2025-09-16 13:59:41.428 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:59:41.428 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 13:59:41.428 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:59:41.428 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=5F69704287C33EE3564EB4EBEDBD28A6, sqlIdList=null, dynamicSql=false) 2025-09-16 13:59:41.432 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:59:41.432 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:59:41.434 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:59:41.434 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:59:41.434 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 13:59:41.434 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 13:59:41.447 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:59:41.447 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=370B05A5B9466AB45BBF52FCEB6743B6, sqlIdList=null, dynamicSql=false) 2025-09-16 13:59:41.448 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:59:41.448 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 13:59:41.449 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 13:59:41.449 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002261344000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=5F69704287C33EE3564EB4EBEDBD28A6, sqlIdList=null, dynamicSql=false) 2025-09-16 13:59:41.453 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 1 records,use plan union hash 2025-09-16 13:59:41.454 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records,use plan union hash 2025-09-16 13:59:41.454 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 0 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:59:41.407, end=2025-09-16T13:57:41.344}, clusterId=1, tenantId=3, sqlId=E9E2014C8CE705871C555597A6A32456, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:59:41.455 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records,use plan union hash 2025-09-16 13:59:41.455 INFO 9 --- [plan_change_detector1,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 0 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:59:41.406, end=2025-09-16T13:57:41.344}, clusterId=1, tenantId=3, sqlId=5F69704287C33EE3564EB4EBEDBD28A6, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:59:41.466 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T13:59:41.402, end=2025-09-16T13:57:41.344}, clusterId=1, tenantId=3, sqlId=370B05A5B9466AB45BBF52FCEB6743B6, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 13:59:41.466 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:59:41.468 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:55:41.19, end=2025-09-16T13:57:41.344},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:59:41.468 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 13:59:41.468 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:59:41.473 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 13:59:41.478 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 1 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:55:41.19, end=2025-09-16T13:57:41.344},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 13:59:41.486 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 13:59:41.486 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 13:59:41.494 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 13:59:42.062 INFO 9 --- [ocp-schedules-7,bbce6e76e37df328,df3406d4301f9a6f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:59:42.067 WARN 9 --- [scanner-1385387-1,bbce6e76e37df328,1f3f2253d8938912] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:59:42.077 INFO 9 --- [alarm-detect-6,bbce6e76e37df328,ed771c9b32cc1b74] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 37, data is empty. 2025-09-16 13:59:42.079 INFO 9 --- [alarm-detect-19,bbce6e76e37df328,69c2928107502b94] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 37, data is empty. 2025-09-16 13:59:42.079 INFO 9 --- [alarm-detect-3,bbce6e76e37df328,9646b1753777f545] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 37, data is empty. 2025-09-16 13:59:42.092 INFO 9 --- [alarm-detect-11,bbce6e76e37df328,9d3d279fed77077c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 37, data is empty. 2025-09-16 13:59:42.596 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:42.597 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:42.613 INFO 9 --- [ocp-schedules-24,3ee4bff2c70efe4e,86bd962e27f69829] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 13:59:42.613 INFO 9 --- [ocp-schedules-24,3ee4bff2c70efe4e,86bd962e27f69829] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 13:59:42.649 INFO 9 --- [ocp-schedules-24,3ee4bff2c70efe4e,86bd962e27f69829] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:42.650 INFO 9 --- [ocp-schedules-24,3ee4bff2c70efe4e,86bd962e27f69829] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 13:59:42.811 INFO 9 --- [ocp-async-9,93dcb983d6b7ccaa,ebff1d692c781961] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:42.811 WARN 9 --- [ocp-async-1,2c080d2cc82dbd51,f82b7daa5719f5fd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:43.636 INFO 9 --- [prometheus-minute-schedule-1,de31844e72a03cdb,3960e91a5899c414] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:43.639 INFO 9 --- [prometheus-minute-schedule-1,de31844e72a03cdb,3960e91a5899c414] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:44.811 INFO 9 --- [ocp-async-7,4814bd20d91c401c,3226ee4aea577bf0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:44.811 WARN 9 --- [ocp-async-10,c4848f5f256249fd,5f9477eff85c2cb2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:44.876 INFO 9 --- [ocp-schedules-7,e25ae7ecc8f2abee,94b875931e39a0b6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:59:45.597 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:45.598 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:46.461 INFO 9 --- [ocp-schedules-18,f9ebf4c5f5f37df9,1003b37712e5603b] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 13:59:46.462 INFO 9 --- [ocp-schedules-18,f9ebf4c5f5f37df9,1003b37712e5603b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:46.513 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:59:46.514 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.516 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 13:59:46.542 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.543 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:59:46.565 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.566 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:59:46.591 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.591 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 13:59:46.594 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.595 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:59:46.618 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.619 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:59:46.636 INFO 9 --- [prometheus-minute-schedule-1,fee9ce0c111861a6,4ff2cac7355d98f6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:46.639 INFO 9 --- [prometheus-minute-schedule-1,fee9ce0c111861a6,4ff2cac7355d98f6] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:46.642 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.642 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 13:59:46.647 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.647 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:59:46.671 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.672 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:59:46.695 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.695 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 13:59:46.717 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.718 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 13:59:46.719 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.720 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:59:46.720 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.721 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:59:46.722 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.722 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 13:59:46.723 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.724 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:59:46.724 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.725 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:59:46.742 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.743 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 13:59:46.743 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.744 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 13:59:46.745 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.746 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 13:59:46.762 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 13:59:46.766 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 13:59:46.794 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 13:59:46.796 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:46.796 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 13:59:46.811 INFO 9 --- [ocp-async-5,791861cf2f04847e,77db92723cf944b0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:46.811 WARN 9 --- [ocp-async-4,a0d10c00a637d177,e855c394b4d6d057] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:46.829 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:59:46.829 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 13:59:46.829 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:59:46.829 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 13:59:46.829 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 13:59:46.829 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 13:59:46.831 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 13:59:46.831 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 13:59:46.831 INFO 9 --- [ocp-schedules-18,f9ebf4c5f5f37df9,1003b37712e5603b] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 13:59:48,031 |-INFO in ReconfigureOnChangeTask(born:1758002328031) - Empty watch file list. Disabling 2025-09-16 13:59:48.598 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:48.598 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:48.811 INFO 9 --- [ocp-async-2,babceb71d0806dfc,fb9acbbc75570908] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:48.811 WARN 9 --- [ocp-async-1,1f5417f19f5d6fbe,ecf2970440168a94] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:49.273 INFO 9 --- [ocp-schedules-1,717f436495d79a07,802630584946b30e] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:59:49.275 INFO 9 --- [ocp-schedules-1,717f436495d79a07,802630584946b30e] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:59:49.636 INFO 9 --- [prometheus-minute-schedule-1,a6dd300c18b78bba,776737597e936e90] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:49.639 INFO 9 --- [prometheus-minute-schedule-1,a6dd300c18b78bba,776737597e936e90] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T13:59:50.004132+08:00, lastProcessTime=2025-09-16T13:59:40.003267+08:00 2025-09-16 13:59:50.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T13:59:50.004132+08:00 2025-09-16 13:59:50.187 INFO 9 --- [ocp-async-4,be59ffe86374dadb,dfd2e208de25e884] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 13:59:50.811 INFO 9 --- [ocp-async-10,b9b344549ab488bc,bbbf3d5525f8cc8c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:50.811 WARN 9 --- [ocp-async-8,410783c7d3ecb687,ab7104615aa39a94] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:51.599 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:51.599 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:52.094 INFO 9 --- [ocp-schedules-9,de7e21c68fcd51a8,b658dc5469ce70ba] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 13:59:52.099 WARN 9 --- [scanner-1385549-1,de7e21c68fcd51a8,4f7ab70a061caf17] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 13:59:52.636 INFO 9 --- [prometheus-minute-schedule-1,d3cedc20fa3034ff,7a98d04b8aa8e777] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:52.639 INFO 9 --- [prometheus-minute-schedule-1,d3cedc20fa3034ff,7a98d04b8aa8e777] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:52.811 INFO 9 --- [ocp-async-4,1db24ef462f6bcd5,2bb28189e1910584] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:52.811 WARN 9 --- [ocp-async-6,2ab16a8f242793c2,df97ac10b9d53a51] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:54.599 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:54.600 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:54.762 INFO 9 --- [ocp-schedules-2,1fb669031cd83f63,bb4b23f92aadf5c6] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 13:59:54.767 INFO 9 --- [ocp-schedules-2,1fb669031cd83f63,bb4b23f92aadf5c6] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:59:54.767 INFO 9 --- [ocp-schedules-2,1fb669031cd83f63,bb4b23f92aadf5c6] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 13:59:54.811 INFO 9 --- [ocp-async-1,3b19d0027269b84d,2c41eb24b0b8b259] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:54.811 WARN 9 --- [ocp-async-2,57ec0b55107cb0bf,09176239a1e55865] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:54.880 INFO 9 --- [ocp-schedules-8,f6432dde9f391b95,590f7f547c1a11e5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 13:59:55.636 INFO 9 --- [prometheus-minute-schedule-1,8e07ad0eb26b7e7c,cd1265c6c81aa5c0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:55.639 INFO 9 --- [prometheus-minute-schedule-1,8e07ad0eb26b7e7c,cd1265c6c81aa5c0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:56.541 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,72eb9de22403f4c0,16169285098056bf] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=72eb9de22403f4c0, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 13:59:56.541 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,72eb9de22403f4c0,16169285098056bf] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=72eb9de22403f4c0, duration=1 ms] 2025-09-16 13:59:56.811 INFO 9 --- [ocp-async-9,7ca7e727025135e4,2ad1420344ad9ea2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:56.811 WARN 9 --- [ocp-async-7,932ee9571c26c860,46536f52b08e47b1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:57.600 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 13:59:57.600 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 13:59:58.636 INFO 9 --- [prometheus-minute-schedule-1,d99fa0ebb13c71b2,e37613d64388ea9b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002400, interval=60 2025-09-16 13:59:58.639 INFO 9 --- [prometheus-minute-schedule-1,d99fa0ebb13c71b2,e37613d64388ea9b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 13:59:58.812 INFO 9 --- [ocp-async-6,7be669aa41e30d61,a2efa55f795032ae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 13:59:58.812 WARN 9 --- [ocp-async-5,629b4634b10ddeb8,9d34aed0ddc8c92f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 13:59:59.279 INFO 9 --- [ocp-schedules-20,34068c43fd96635d,7853516448d3193b] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 13:59:59.281 INFO 9 --- [ocp-schedules-20,34068c43fd96635d,7853516448d3193b] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 13:59:59.938 INFO 9 --- [ocp-schedules-4,01ce2630860f59d5,2279d37ca25f57f3] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 13:59:59.941 INFO 9 --- [ocp-schedules-4,d50c626df0550fba,bb182bf40793d04e] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 13:59:59.941 INFO 9 --- [ocp-schedules-10,5d6c217dfd8e6eee,ec921c299ba8117f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 13:59:59.942 INFO 9 --- [ocp-schedules-22,f7a9d47f04fb1676,ef01c8ab291dcc4a] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 13:59:59.942 INFO 9 --- [ocp-schedules-4,d50c626df0550fba,bb182bf40793d04e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:59.943 INFO 9 --- [ocp-schedules-10,5d6c217dfd8e6eee,ec921c299ba8117f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:59.943 INFO 9 --- [ocp-schedules-22,f7a9d47f04fb1676,ef01c8ab291dcc4a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 13:59:59.943 INFO 9 --- [ocp-schedules-22,f7a9d47f04fb1676,ef01c8ab291dcc4a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 13:59:59.944 INFO 9 --- [ocp-schedules-21,d8b3091c55b4ff14,ea7a09fedd59254b] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:59:59.944 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:59:59.945 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:59:59.945 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:59:59.945 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:59:59.945 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:59:59.945 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:59:59.945 INFO 9 --- [ocp-schedules-9,10536647ae3340cc,d7aa39b9d0a659e9] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:59:59.945 INFO 9 --- [host-check-agent-status1,10536647ae3340cc,3f7a9d83e0246ce2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 13:59:59.945 INFO 9 --- [ocp-schedules-25,b94617d83d223146,579a823e00b70c79] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 13:59:59.945 INFO 9 --- [host-check-agent-status2,10536647ae3340cc,255dc23ea18ff467] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 13:59:59.945 INFO 9 --- [host-check-agent-status3,10536647ae3340cc,61e0b0285dda4843] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 13:59:59.946 INFO 9 --- [host-check-clockdiff1,b94617d83d223146,acd67274d33d3e77] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 13:59:59.946 INFO 9 --- [host-check-agent-status4,10536647ae3340cc,622f4e79e489dce8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 13:59:59.946 INFO 9 --- [host-check-clockdiff2,b94617d83d223146,2346d08c3fa49cf3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 13:59:59.946 INFO 9 --- [host-check-agent-status5,10536647ae3340cc,c083294db9d55bdf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 13:59:59.946 INFO 9 --- [host-check-clockdiff3,b94617d83d223146,aef14ed8cd33ad55] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 13:59:59.946 INFO 9 --- [host-check-clockdiff4,b94617d83d223146,b98a9f44f993739c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 13:59:59.946 INFO 9 --- [host-check-agent-status6,10536647ae3340cc,882298b0f4ba36e0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 13:59:59.946 INFO 9 --- [host-check-clockdiff5,b94617d83d223146,38b5cd3e1d9d00ab] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 13:59:59.946 INFO 9 --- [host-check-clockdiff6,b94617d83d223146,b9a6d9e90a10e563] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 13:59:59.948 INFO 9 --- [ocp-schedules-17,a45837f62f7b6680,c38c8b0d3996f912] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 13:59:59.952 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:59.952 INFO 9 --- [host-check-clockdiff3,b94617d83d223146,aef14ed8cd33ad55] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002399 -1 -1 , error= 2025-09-16 13:59:59.953 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:59.954 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:59.954 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:59.954 INFO 9 --- [host-check-clockdiff5,b94617d83d223146,38b5cd3e1d9d00ab] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002399 -1 -1 , error= 2025-09-16 13:59:59.954 INFO 9 --- [host-check-clockdiff1,b94617d83d223146,acd67274d33d3e77] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002399 -1 -1 , error= 2025-09-16 13:59:59.954 INFO 9 --- [host-check-clockdiff4,b94617d83d223146,b98a9f44f993739c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002399 -1 -1 , error= 2025-09-16 13:59:59.955 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:59.956 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:59.956 INFO 9 --- [host-check-agent-status1,10536647ae3340cc,3f7a9d83e0246ce2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:59.956 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:59.956 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:59.956 INFO 9 --- [host-check-clockdiff2,b94617d83d223146,2346d08c3fa49cf3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002399 -1 -1 , error= 2025-09-16 13:59:59.956 INFO 9 --- [host-check-agent-status5,10536647ae3340cc,c083294db9d55bdf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:59.956 INFO 9 --- [host-check-agent-status3,10536647ae3340cc,61e0b0285dda4843] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:59.956 INFO 9 --- [host-check-agent-status2,10536647ae3340cc,255dc23ea18ff467] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:59.956 INFO 9 --- [host-check-clockdiff6,b94617d83d223146,b9a6d9e90a10e563] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002399 -1 -1 , error= 2025-09-16 13:59:59.956 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:59.957 INFO 9 --- [host-check-agent-status4,10536647ae3340cc,622f4e79e489dce8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:59.957 INFO 9 --- [host-check-agent-status6,10536647ae3340cc,882298b0f4ba36e0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:59.957 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:59.958 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:59.958 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:59.958 INFO 9 --- [host-check-agent-status1,10536647ae3340cc,3f7a9d83e0246ce2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:59.958 INFO 9 --- [host-check-agent-status6,10536647ae3340cc,882298b0f4ba36e0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:59.958 INFO 9 --- [host-check-agent-status2,10536647ae3340cc,255dc23ea18ff467] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:59.958 INFO 9 --- [host-check-agent-status4,10536647ae3340cc,622f4e79e489dce8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:59.958 INFO 9 --- [host-check-agent-status3,10536647ae3340cc,61e0b0285dda4843] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:59.959 INFO 9 --- [host-check-agent-status5,10536647ae3340cc,c083294db9d55bdf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:59.970 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 13:59:59.971 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 13:59:59.971 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 13:59:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:59.972 INFO 9 --- [host-check-agent-status6,10536647ae3340cc,882298b0f4ba36e0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 13:59:59.972 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 13:59:59.972 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 13:59:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 13:59:59.972 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T13:59:59.971399295+08:00 2025-09-16 13:59:59.972 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 13:59:59.973 INFO 9 --- [host-check-agent-status3,10536647ae3340cc,61e0b0285dda4843] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 13:59:59.973 INFO 9 --- [host-check-agent-status2,10536647ae3340cc,255dc23ea18ff467] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 13:59:59.973 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T13:59:59.972+08:00 2025-09-16 13:59:59.973 INFO 9 --- [host-check-agent-status1,10536647ae3340cc,3f7a9d83e0246ce2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 13:59:59.973 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T13:59:59.971784798+08:00 2025-09-16 13:59:59.973 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T13:59:59.972119860+08:00 2025-09-16 13:59:59.973 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T13:59:59.973+08:00 2025-09-16 13:59:59.974 INFO 9 --- [host-check-agent-status5,10536647ae3340cc,c083294db9d55bdf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T13:59:59.973+08:00 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T13:59:59.972932897+08:00 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T13:59:59.973015752+08:00 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T13:59:59.972897902+08:00 2025-09-16 13:59:59.974 INFO 9 --- [host-check-agent-status4,10536647ae3340cc,622f4e79e489dce8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T13:59:59.974+08:00 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T13:59:59.974+08:00 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T13:59:59.972+08:00 and status AVAILABLE 2025-09-16 13:59:59.974 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T13:59:59.974+08:00 2025-09-16 13:59:59.975 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T13:59:59.973+08:00 and status AVAILABLE 2025-09-16 13:59:59.975 INFO 9 --- [host-check-agent-status6,10536647ae3340cc,882298b0f4ba36e0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 13:59:59.975 INFO 9 --- [host-check-agent-status6,10536647ae3340cc,882298b0f4ba36e0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 13:59:59.975 INFO 9 --- [host-check-agent-status6,10536647ae3340cc,882298b0f4ba36e0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 13:59:59.975 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T13:59:59.973+08:00 and status AVAILABLE 2025-09-16 13:59:59.975 INFO 9 --- [host-check-agent-status1,10536647ae3340cc,3f7a9d83e0246ce2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 13:59:59.975 INFO 9 --- [host-check-agent-status1,10536647ae3340cc,3f7a9d83e0246ce2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 13:59:59.975 INFO 9 --- [host-check-agent-status1,10536647ae3340cc,3f7a9d83e0246ce2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 13:59:59.976 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T13:59:59.974+08:00 and status AVAILABLE 2025-09-16 13:59:59.976 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T13:59:59.974+08:00 and status AVAILABLE 2025-09-16 13:59:59.976 INFO 9 --- [host-check-agent-status2,10536647ae3340cc,255dc23ea18ff467] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 13:59:59.976 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T13:59:59.974+08:00 and status AVAILABLE 2025-09-16 13:59:59.976 INFO 9 --- [host-check-agent-status2,10536647ae3340cc,255dc23ea18ff467] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 13:59:59.976 INFO 9 --- [host-check-agent-status2,10536647ae3340cc,255dc23ea18ff467] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 13:59:59.976 INFO 9 --- [host-check-agent-status5,10536647ae3340cc,c083294db9d55bdf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 13:59:59.976 INFO 9 --- [host-check-agent-status5,10536647ae3340cc,c083294db9d55bdf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 13:59:59.976 INFO 9 --- [host-check-agent-status5,10536647ae3340cc,c083294db9d55bdf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 13:59:59.977 INFO 9 --- [host-check-agent-status3,10536647ae3340cc,61e0b0285dda4843] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 13:59:59.977 INFO 9 --- [host-check-agent-status3,10536647ae3340cc,61e0b0285dda4843] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 13:59:59.977 INFO 9 --- [host-check-agent-status3,10536647ae3340cc,61e0b0285dda4843] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 13:59:59.977 INFO 9 --- [host-check-agent-status4,10536647ae3340cc,622f4e79e489dce8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 13:59:59.977 INFO 9 --- [host-check-agent-status4,10536647ae3340cc,622f4e79e489dce8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 13:59:59.977 INFO 9 --- [host-check-agent-status4,10536647ae3340cc,622f4e79e489dce8] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 13:59:59.977 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 13:59:59.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 13:59:59.978 INFO 9 --- [ocp-schedules-10,5d6c217dfd8e6eee,ec921c299ba8117f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 13:59:59.979 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 13:59:59.979 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 13:59:59.979 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 13:59:59.979 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 13:59:59.979 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 13:59:59.983 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 13:59:59.984 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 13:59:59.985 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 13:59:59.985 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 13:59:59.985 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 13:59:59.985 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 13:59:59.985 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 13:59:59.986 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 13:59:59.986 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 13:59:59.986 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 13:59:59.986 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 13:59:59.986 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 13:59:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 13:59:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 13:59:59.999 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 13:59:59.999 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:00.000 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:00.001 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:00.001 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:00.002 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:00.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:00:00.003915+08:00, lastProcessTime=2025-09-16T13:59:50.004132+08:00 2025-09-16 14:00:00.027 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:00:00.027 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:00:00.027 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:00.028 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:00:00.029 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:00.029 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:00:00.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:00:00.030 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:00:00.031 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:00:00.033 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:00:00.034 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:00:00.035 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:00:00.036 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:00:00.036 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:00:00.037 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:00:00.046 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:00.047 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:00.047 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:00.048 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:00.048 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:00.048 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:00.064 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:00.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:00.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:00:00.073 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:00:00.075 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:00:00.075 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:00:00.076 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:00:00.076 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:00:00.077 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:00:00.079 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:00:00.082 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:00:00.082 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:00:00.083 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:00:00.083 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:00:00.083 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:00:00.091 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:00.093 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:00.095 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:00.095 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:00.095 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:00.095 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:00.096 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:00.098 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:00:00.100 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:00.115 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.115 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:00.123 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:00:00.123 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:00:00.123 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:00:00.123 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:00:00.124 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:00:00.126 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:00:00.130 INFO 9 --- [host-check-host-status2,d8b3091c55b4ff14,a214dbdc789ef746] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:00:00.130 INFO 9 --- [host-check-host-status4,d8b3091c55b4ff14,1a79a9c27204b902] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:00:00.130 INFO 9 --- [host-check-host-status3,d8b3091c55b4ff14,651df9337e1ab196] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:00:00.130 INFO 9 --- [host-check-host-status5,d8b3091c55b4ff14,a7c7921ffb7507bf] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:00:00.131 INFO 9 --- [host-check-host-status1,d8b3091c55b4ff14,d3039c8d94b94b09] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:00:00.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:00.133 INFO 9 --- [host-check-host-status6,d8b3091c55b4ff14,5fe67d5385fbe2ad] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:00:00.134 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:00:00.003915+08:00 2025-09-16 14:00:00.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.147 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:00.163 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.163 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.176 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:00.188 INFO 9 --- [ocp-async-7,23faac11b0329e3b,7181c10be56da0fb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:00:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:00.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:00.221 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.221 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:00.234 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.234 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:00.250 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:00.264 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:00.265 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:00.266 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:00.271 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:00:00.274 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:00:00.277 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:00.278 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:00.291 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:00:00.316 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 12:00:01.0, nextRun=2025-09-16 14:00:00.0, currentDate=Tue Sep 16 14:00:00 CST 2025 2025-09-16 14:00:00.316 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999974, name=Detect log piece, templateName=BackupDetectLogPieceSchedule, scheduleRule=0 0 */2 * * ?, lastRunTime=2025-09-16 12:00:01.0, nextRunTime=2025-09-16 14:00:00.0} 2025-09-16 14:00:00.321 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Detect log piece, nodeCount=1, taskCount=1 2025-09-16 14:00:00.321 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Detect log piece', taskDefinitionId=999974, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T14:00:00.321+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Detect log piece, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.schedule.DetectLogPieceTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 14:00:00.329 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:55:01.0, nextRun=2025-09-16 14:00:00.0, currentDate=Tue Sep 16 14:00:00 CST 2025 2025-09-16 14:00:00.329 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999977, name=DiagFuncUpdateSchedule, templateName=DiagFuncUpdateSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:55:01.0, nextRunTime=2025-09-16 14:00:00.0} 2025-09-16 14:00:00.332 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=DiagFuncUpdateSchedule, nodeCount=1, taskCount=1 2025-09-16 14:00:00.332 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='DiagFuncUpdateSchedule', taskDefinitionId=999977, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T14:00:00.332+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Update diag function, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.diagnosis.task.DiagFuncUpdateTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 14:00:00.334 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,2ae9427d419c59fc] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1349, operation:EXECUTE, state: RUNNING 2025-09-16 14:00:00.338 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:55:01.0, nextRun=2025-09-16 14:00:00.0, currentDate=Tue Sep 16 14:00:00 CST 2025 2025-09-16 14:00:00.338 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 13:55:01.0, nextRunTime=2025-09-16 14:00:00.0} 2025-09-16 14:00:00.345 INFO 9 --- [subtask-executor30,25e389618b93fdc9,e846f9ea43635c1d] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 14:00:00.345 INFO 9 --- [subtask-executor30,25e389618b93fdc9,e846f9ea43635c1d] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1349, context=Context{parallelIdx=-1, stringMap={task_instance_id=822, task_operation=execute, latest_execution_start_time=2025-09-16T14:00:00.330+08:00, sub_task_instance_name=Detect log piece, sub_task_instance_id=1349}, listMap={}}, executor=10.233.116.22 2025-09-16 14:00:00.345 INFO 9 --- [subtask-executor30,25e389618b93fdc9,e846f9ea43635c1d] c.o.o.b.i.t.schedule.DetectLogPieceTask : start detect log piece task. 2025-09-16 14:00:00.350 INFO 9 --- [subtask-executor30,25e389618b93fdc9,e846f9ea43635c1d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1349, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 14:00:00.352 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[1] 2025-09-16 14:00:00.352 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:00:00.356 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.p.s.internal.SqlParseTaskSchedule : HighRiskSql Parse is ready 2025-09-16 14:00:00.359 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=SqlParseTaskSchedule, nodeCount=1, taskCount=1 2025-09-16 14:00:00.359 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67b737190512f15a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='SqlParseTaskSchedule', taskDefinitionId=999985, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={cluster_ids=[[1]]}}, createTime=null, startTime=2025-09-16T14:00:00.359+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Sql Parse Task, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.task.SqlParseTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 14:00:00.367 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:00.368 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:00.369 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:00:00.384 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:00:00.384 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:00:00.384 INFO 9 --- [ocp-schedules-4,d50c626df0550fba,bb182bf40793d04e] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:00:00.442 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:822, status:SUCCESS 2025-09-16 14:00:00.442 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:822, status:SUCCESS 2025-09-16 14:00:00.600 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:00.601 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:00.812 INFO 9 --- [ocp-async-3,29ae2060654e90b6,6732871869f2d773] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:00.812 WARN 9 --- [ocp-async-1,9db055e5ec2058b6,42d71d806da13866] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:00.868 INFO 9 --- [ocp-schedules-8,a1a6d981eee422bc,fa48a6308f3bc115] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:00:01.345 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,fdfa1a2de61f89be] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1350, operation:EXECUTE, state: RUNNING 2025-09-16 14:00:01.351 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,fdfa1a2de61f89be] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1351, operation:EXECUTE, state: RUNNING 2025-09-16 14:00:01.355 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 14:00:01.355 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1350, context=Context{parallelIdx=-1, stringMap={task_instance_id=823, task_operation=execute, latest_execution_start_time=2025-09-16T14:00:01.343+08:00, sub_task_instance_name=Update diag function, sub_task_instance_id=1350}, listMap={}}, executor=10.233.116.22 2025-09-16 14:00:01.360 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 14:00:01.363 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1351, context=Context{parallelIdx=0, stringMap={subtask_splitter=cluster_ids, task_instance_id=824, task_operation=execute, latest_execution_start_time=2025-09-16T14:00:01.350+08:00, sub_task_instance_name=Sql Parse Task, sub_task_instance_id=1351}, listMap={cluster_ids=[[1]]}}, executor=10.233.116.22 2025-09-16 14:00:01.363 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.o.p.sql.internal.task.SqlParseTask : parse sql for cluster:1 2025-09-16 14:00:01.372 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.406 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1002,1757980800000000,2000,30000000 2025-09-16 14:00:01.409 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.o.perf.sql.internal.SqlParseService : parse 0 sqls for tenant:ObTenantEntity{id=2, name=cos, obTenantId=1002, status=NORMAL} 2025-09-16 14:00:01.432 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.438 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1004,1757980800000000,2000,30000000 2025-09-16 14:00:01.441 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.o.perf.sql.internal.SqlParseService : parse 2 sqls for tenant:ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL} 2025-09-16 14:00:01.459 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.494 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.518 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.543 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.546 INFO 9 --- [subtask-executor31,25e389618b93fdc9,32ac31438b4a3909] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1351, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 14:00:01.566 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.579 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.o.DiskUsageTimeRemainingOperator : no metrics data, skip predicting for zhengqi 2025-09-16 14:00:01.580 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:00:01.636 INFO 9 --- [prometheus-minute-schedule-1,4ef6653844322db1,eef8b2f651605fbf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:01.639 INFO 9 --- [prometheus-minute-schedule-1,4ef6653844322db1,eef8b2f651605fbf] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:01.656 INFO 9 --- [subtask-executor30,25e389618b93fdc9,caa200c0f2afe7f1] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1350, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 14:00:02.120 INFO 9 --- [ocp-schedules-20,82777e5758725a5c,65a841470043e205] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:00:02.126 WARN 9 --- [scanner-1385772-1,82777e5758725a5c,87a0baa273a44d04] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:00:02.135 INFO 9 --- [alarm-detect-8,82777e5758725a5c,9d297551611a611e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 37, data is empty. 2025-09-16 14:00:02.138 INFO 9 --- [alarm-detect-4,82777e5758725a5c,de786261ba3149e7] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 37, data is empty. 2025-09-16 14:00:02.138 INFO 9 --- [alarm-detect-2,82777e5758725a5c,ed4eaaa2b0898ede] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 37, data is empty. 2025-09-16 14:00:02.151 INFO 9 --- [alarm-detect-9,82777e5758725a5c,c9119476179d397c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 37, data is empty. 2025-09-16 14:00:02.459 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:823, status:SUCCESS 2025-09-16 14:00:02.459 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:823, status:SUCCESS 2025-09-16 14:00:02.464 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:824, status:SUCCESS 2025-09-16 14:00:02.465 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:824, status:SUCCESS 2025-09-16 14:00:02.812 WARN 9 --- [ocp-async-9,8e2cb413361dd5a5,6cc224891c195acf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:02.812 INFO 9 --- [ocp-async-8,dc665fcf2775da8d,09acc41425a38820] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:03.601 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:03.602 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:04.431 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67cc0a495659bb4a] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:50:05.0, nextRun=2025-09-16 14:00:04.0, currentDate=Tue Sep 16 14:00:04 CST 2025 2025-09-16 14:00:04.431 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67cc0a495659bb4a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999999, name=Partitioning daemon, templateName=PartitioningDaemonSchedule, scheduleRule=4 */10 * * * *, lastRunTime=2025-09-16 13:50:05.0, nextRunTime=2025-09-16 14:00:04.0} 2025-09-16 14:00:04.435 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67cc0a495659bb4a] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Partition rollover daemon, nodeCount=1, taskCount=1 2025-09-16 14:00:04.435 INFO 9 --- [task-coordinator3,25e389618b93fdc9,67cc0a495659bb4a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Partition rollover daemon', taskDefinitionId=999999, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T14:00:04.435+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Partition rollover daemon, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 14:00:04.636 INFO 9 --- [prometheus-minute-schedule-1,6c357f61fb6d5240,f83c0db318bece60] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:04.639 INFO 9 --- [prometheus-minute-schedule-1,6c357f61fb6d5240,f83c0db318bece60] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:04.812 INFO 9 --- [ocp-async-5,ee4a8b0ab67c0c18,49820ea0eb583628] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:04.812 WARN 9 --- [ocp-async-6,2f505b47e1cb3208,7404fa78b08ace3b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:04.883 INFO 9 --- [ocp-schedules-20,072e160d745f127a,d8eb42a403e59b12] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:00:05.366 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,5ac60aef5c8f8e9b] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1352, operation:EXECUTE, state: RUNNING 2025-09-16 14:00:05.376 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 14:00:05.377 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1352, context=Context{parallelIdx=-1, stringMap={task_instance_id=825, task_operation=execute, latest_execution_start_time=2025-09-16T14:00:05.364+08:00, sub_task_instance_name=Partition rollover daemon, sub_task_instance_id=1352}, listMap={}}, executor=10.233.116.22 2025-09-16 14:00:05.382 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2025-09-16 14:00:05.382 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2025-09-16 14:00:05.388 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.389 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:05.390 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.390 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.391 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.391 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2025-09-16 14:00:05.397 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.397 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.397 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.398 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_cache_info 2025-09-16 14:00:05.403 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2025-09-16 14:00:05.403 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2025-09-16 14:00:05.404 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.405 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:05.406 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.406 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.407 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.407 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2025-09-16 14:00:05.418 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.419 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.419 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.420 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_0 2025-09-16 14:00:05.430 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.431 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.431 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.432 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2025-09-16 14:00:05.441 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.442 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.442 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.443 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_1 2025-09-16 14:00:05.452 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.453 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.453 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.454 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2025-09-16 14:00:05.464 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.464 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.465 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.465 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_2 2025-09-16 14:00:05.475 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.475 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.476 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.476 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2025-09-16 14:00:05.486 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.487 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.487 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.487 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2025-09-16 14:00:05.493 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.493 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.494 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.494 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sqltext 2025-09-16 14:00:05.500 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.500 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.500 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.501 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_dynamic_sql 2025-09-16 14:00:05.505 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.506 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.506 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.507 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_high_risk_sql 2025-09-16 14:00:05.512 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.512 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.512 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.513 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2025-09-16 14:00:05.519 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.519 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.519 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.520 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_stat_0 2025-09-16 14:00:05.526 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.526 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.527 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.527 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2025-09-16 14:00:05.532 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.533 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.533 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.533 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan 2025-09-16 14:00:05.539 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.539 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.539 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.540 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2025-09-16 14:00:05.545 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.545 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.546 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.546 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_explain 2025-09-16 14:00:05.551 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.552 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.552 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.553 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2025-09-16 14:00:05.560 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.560 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.561 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.562 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_sample 2025-09-16 14:00:05.569 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.570 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.570 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.571 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample_statistics 2025-09-16 14:00:05.579 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.580 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.580 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.580 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2025-09-16 14:00:05.585 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.586 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.586 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.586 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2025-09-16 14:00:05.592 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.592 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.593 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.593 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2025-09-16 14:00:05.598 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.598 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.599 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.599 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2025-09-16 14:00:05.604 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.604 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.605 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.605 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2025-09-16 14:00:05.610 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.611 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.611 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.612 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2025-09-16 14:00:05.617 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.617 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.617 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.618 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2025-09-16 14:00:05.623 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.623 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.624 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.624 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2025-09-16 14:00:05.629 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.629 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.629 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.630 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2025-09-16 14:00:05.634 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.635 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.635 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.636 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2025-09-16 14:00:05.641 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.641 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.641 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.642 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2025-09-16 14:00:05.646 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.647 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.647 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.648 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2025-09-16 14:00:05.652 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.653 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.653 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.653 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2025-09-16 14:00:05.658 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.658 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.659 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.659 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2025-09-16 14:00:05.664 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.664 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.664 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.665 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2025-09-16 14:00:05.669 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.670 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.670 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.670 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2025-09-16 14:00:05.675 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.675 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.675 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.676 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2025-09-16 14:00:05.680 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.681 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.681 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.681 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2025-09-16 14:00:05.686 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.686 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.686 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.687 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2025-09-16 14:00:05.691 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.692 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.692 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.692 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_memory 2025-09-16 14:00:05.697 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.697 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.698 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.698 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_hit 2025-09-16 14:00:05.703 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.703 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.703 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.704 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2025-09-16 14:00:05.710 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.710 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.711 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.711 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_v2 2025-09-16 14:00:05.717 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.717 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.718 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.718 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2025-09-16 14:00:05.722 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.723 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.723 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.723 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_server_event 2025-09-16 14:00:05.727 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.727 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.728 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.728 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2025-09-16 14:00:05.733 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.733 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.733 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.734 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2025-09-16 14:00:05.738 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.738 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.739 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.739 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2025-09-16 14:00:05.744 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.744 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.744 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.745 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2025-09-16 14:00:05.749 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.749 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.749 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.750 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2025-09-16 14:00:05.754 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.755 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.755 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.756 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2025-09-16 14:00:05.760 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.761 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.761 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.761 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2025-09-16 14:00:05.766 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.766 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.766 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.767 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2025-09-16 14:00:05.771 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.772 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.772 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.772 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_async 2025-09-16 14:00:05.777 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.777 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.777 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.778 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2025-09-16 14:00:05.781 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.781 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.781 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.782 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2025-09-16 14:00:05.786 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.786 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:05.787 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:05.787 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2025-09-16 14:00:05.791 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2025-09-16 14:00:05.802 INFO 9 --- [subtask-executor30,25e389618b93fdc9,f773745b33721d29] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1352, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 14:00:06.481 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:825, status:SUCCESS 2025-09-16 14:00:06.482 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:825, status:SUCCESS 2025-09-16 14:00:06.602 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:06.603 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:06.812 INFO 9 --- [ocp-async-4,7cc2ba43ce16cd94,e1834bdb3d013a60] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:06.812 WARN 9 --- [ocp-async-2,6a3fb5c8237ce65b,348c06d3d8afe1b7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:07.636 INFO 9 --- [prometheus-minute-schedule-1,e85662b0e8548b02,ec582e74183c6989] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:07.639 INFO 9 --- [prometheus-minute-schedule-1,e85662b0e8548b02,ec582e74183c6989] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:08.812 INFO 9 --- [ocp-async-9,d395bce7c04001ba,d770859e8f5871f6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:08.812 WARN 9 --- [ocp-async-7,29a34b9971c0e10f,4dfe4450291f907c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:09.287 INFO 9 --- [ocp-schedules-3,a302aeced91b6108,5cb244acf2f61bf3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:00:09.289 INFO 9 --- [ocp-schedules-3,a302aeced91b6108,5cb244acf2f61bf3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:00:09.603 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:09.603 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:10.002 INFO 9 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 14:00:10.002 INFO 9 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 14:00:10.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:00:10.003385+08:00, lastProcessTime=2025-09-16T14:00:00.003915+08:00 2025-09-16 14:00:10.115 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:00:10.003385+08:00 2025-09-16 14:00:10.188 INFO 9 --- [ocp-async-2,a30d0920bede7abe,ab442278de0cdf25] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:00:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 14:00:10.636 INFO 9 --- [prometheus-minute-schedule-1,a67fd82406daa9a8,3bac73ca30cbe8e2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:10.639 INFO 9 --- [prometheus-minute-schedule-1,a67fd82406daa9a8,3bac73ca30cbe8e2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:10.812 INFO 9 --- [ocp-async-10,b32fc11f1360d291,7e426e26bc39449b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:10.812 WARN 9 --- [ocp-async-5,ec103f88574c2c08,fd21ba8e92b22d14] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:11.762 INFO 9 --- [metric-archive-async-2,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002340, nodeCount=460, affectRows=460 2025-09-16 14:00:12.154 INFO 9 --- [ocp-schedules-15,ac0bc5f3140f5575,6025f09ff8bee4aa] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:00:12.160 WARN 9 --- [scanner-1386813-1,ac0bc5f3140f5575,5bd0c1362a69655f] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:00:12.603 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:12.604 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:12.812 INFO 9 --- [ocp-async-2,f5512b1ba169ff91,99aa8f95b80224c3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:12.812 WARN 9 --- [ocp-async-4,4d943831f11a8c5c,ea6b51ab0d27d7d6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:13.636 INFO 9 --- [prometheus-minute-schedule-1,d840325bc4c4e197,e281ca31fc7c8853] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:13.639 INFO 9 --- [prometheus-minute-schedule-1,d840325bc4c4e197,e281ca31fc7c8853] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:14.572 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002340, nodeCount=1000, affectRows=1000 2025-09-16 14:00:14.574 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002340, nodeCount=1000, validCount=996 2025-09-16 14:00:14.599 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002340, nodeCount=1000, affectRows=1000 2025-09-16 14:00:14.601 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002340, nodeCount=1000, validCount=998 2025-09-16 14:00:14.612 ERROR 9 --- [metric-archive-second-5,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952599621632-1758002280' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952599621632-1758002280' for key 'PRIMARY' 2025-09-16 14:00:14.768 INFO 9 --- [ocp-schedules-20,8c27f7462285b7d5,6d1551073d4d691b] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:00:14.772 INFO 9 --- [ocp-schedules-20,8c27f7462285b7d5,6d1551073d4d691b] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:00:14.772 INFO 9 --- [ocp-schedules-20,8c27f7462285b7d5,6d1551073d4d691b] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:00:14.813 WARN 9 --- [ocp-async-3,2f126fdc73b80ae1,64c7ad246de7f788] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:14.813 INFO 9 --- [ocp-async-9,b286d7f3fb9533f7,9bef8e9d557c16e5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:14.887 INFO 9 --- [ocp-schedules-16,51fb1815d7fd351b,e2987789add214e9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:00:15.192 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002340, nodeCount=853, affectRows=853 2025-09-16 14:00:15.194 INFO 9 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002340, nodeCount=852, validCount=850 2025-09-16 14:00:15.604 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:15.604 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:15.965 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002340, nodeCount=1000, affectRows=1000 2025-09-16 14:00:15.967 INFO 9 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002340, nodeCount=992, validCount=946 2025-09-16 14:00:16.636 INFO 9 --- [prometheus-minute-schedule-1,5e4f89e9d546360c,7061e9d7ff36e1ce] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:16.639 INFO 9 --- [prometheus-minute-schedule-1,5e4f89e9d546360c,7061e9d7ff36e1ce] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:16.813 WARN 9 --- [ocp-async-8,b93a599a11197016,7479b6b4f3cccb2e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:16.813 INFO 9 --- [ocp-async-6,d9c34b7c40459016,87720f8adbd32bf9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:18.605 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:18.605 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:18.813 WARN 9 --- [ocp-async-10,17efb22ed30913e4,639bb9de8516915a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:18.813 INFO 9 --- [ocp-async-10,692b50dc40402e11,82f036255bc36f49] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:19.294 INFO 9 --- [ocp-schedules-12,9224762e99ee5f5b,0b96811ba318e061] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:00:19.296 INFO 9 --- [ocp-schedules-12,9224762e99ee5f5b,0b96811ba318e061] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:00:19.636 INFO 9 --- [prometheus-minute-schedule-1,9c9e5c59cfc8abaf,9aaa5652fff4b989] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:19.639 INFO 9 --- [prometheus-minute-schedule-1,9c9e5c59cfc8abaf,9aaa5652fff4b989] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:00:20.003410+08:00, lastProcessTime=2025-09-16T14:00:10.003385+08:00 2025-09-16 14:00:20.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:00:20.003410+08:00 2025-09-16 14:00:20.188 INFO 9 --- [ocp-async-8,9dfa1fa1a8e5bb79,ddfbbb07771dbe2a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:00:20.636 INFO 9 --- [prometheus-cache-monitor1,34468cd93c28d5ef,8b7575b477d78ece] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":10006} 2025-09-16 14:00:20.636 INFO 9 --- [prometheus-cache-monitor1,34468cd93c28d5ef,8b7575b477d78ece] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:00:20.813 WARN 9 --- [ocp-async-3,8a289ad9c24f0ce5,6db45f4ba92bd215] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:20.813 INFO 9 --- [ocp-async-9,000d70267daa37fd,343828bbd49ab540] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:21.605 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:21.606 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:22.182 INFO 9 --- [ocp-schedules-17,f6245b7fcb916cc3,85a80e18ec78adab] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:00:22.188 WARN 9 --- [scanner-1386940-1,f6245b7fcb916cc3,34137ae5f01f598f] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:00:22.197 INFO 9 --- [alarm-detect-8,f6245b7fcb916cc3,cc9da9bdca638bbf] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 37, data is empty. 2025-09-16 14:00:22.199 INFO 9 --- [alarm-detect-12,f6245b7fcb916cc3,c19b37ddd22d60e9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 37, data is empty. 2025-09-16 14:00:22.199 INFO 9 --- [alarm-detect-1,f6245b7fcb916cc3,474c9f9bf3f92384] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 37, data is empty. 2025-09-16 14:00:22.212 INFO 9 --- [alarm-detect-4,f6245b7fcb916cc3,a7b7dd1cadffe2bc] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 37, data is empty. 2025-09-16 14:00:22.636 INFO 9 --- [prometheus-minute-schedule-1,4ab6d21f36101e38,a570229e7f6f0585] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:22.639 INFO 9 --- [prometheus-minute-schedule-1,4ab6d21f36101e38,a570229e7f6f0585] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:22.813 WARN 9 --- [ocp-async-8,c6b21419b21bc821,d1619dc9ec88fabe] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:22.813 INFO 9 --- [ocp-async-6,c5cfe6892e820aba,7f18bb992754714f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:24.606 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:24.606 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:24.813 WARN 9 --- [ocp-async-4,e5d4c74c9991344c,c31e778046d49c5b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:24.813 INFO 9 --- [ocp-async-10,443b867c3e4a40ab,1c5aef21204b5813] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:24.890 INFO 9 --- [ocp-schedules-6,c8fc294d9d74f853,21331ac6df15f66f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:00:25.636 INFO 9 --- [prometheus-minute-schedule-1,24757eff6091748b,e5031f58ccf71c30] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:25.639 INFO 9 --- [prometheus-minute-schedule-1,24757eff6091748b,e5031f58ccf71c30] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:26.813 WARN 9 --- [ocp-async-3,9f1f0d14a62d19b8,bdd7b65b3d2d08d2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:26.813 INFO 9 --- [ocp-async-7,e5df7e31c21dcbd8,1ce625ea3b3d3966] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:27.607 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:27.607 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:28.636 INFO 9 --- [prometheus-minute-schedule-1,ea53e4506abd2c08,2dbf18eb8926ec32] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:28.640 INFO 9 --- [prometheus-minute-schedule-1,ea53e4506abd2c08,2dbf18eb8926ec32] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:28.813 WARN 9 --- [ocp-async-8,4a0c0a2b70b8ae62,627d882c6e858642] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:28.813 INFO 9 --- [ocp-async-5,46709c819aa99196,0c480f488f0428c5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:29.301 INFO 9 --- [ocp-schedules-9,3032700bafe16531,01fd2dccf9b55201] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:00:29.303 INFO 9 --- [ocp-schedules-9,3032700bafe16531,01fd2dccf9b55201] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:00:29.938 INFO 9 --- [ocp-schedules-28,db43320308b189f3,d1577833177721e0] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:00:29.941 INFO 9 --- [ocp-schedules-21,371057fac82a6cfc,140bb3b02d5d7bdd] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:00:29.941 INFO 9 --- [ocp-schedules-16,2629d51ea2a480ef,5ad6af08eae3576a] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:00:29.942 INFO 9 --- [ocp-schedules-7,adcea7916074b2c2,2ccf69f3858ba4fd] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:00:29.942 INFO 9 --- [ocp-schedules-21,371057fac82a6cfc,140bb3b02d5d7bdd] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:29.943 INFO 9 --- [ocp-schedules-16,2629d51ea2a480ef,5ad6af08eae3576a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:29.943 INFO 9 --- [ocp-schedules-7,adcea7916074b2c2,2ccf69f3858ba4fd] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:29.944 INFO 9 --- [ocp-schedules-7,adcea7916074b2c2,2ccf69f3858ba4fd] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:00:29.944 INFO 9 --- [ocp-schedules-19,6204575d5d247367,020d3e486204e409] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:29.945 INFO 9 --- [ocp-schedules-1,ef707660d439a299,2355bc5ea9229dde] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:29.945 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-agent-status1,ef707660d439a299,a412e0d2c2b0a95a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-agent-status2,ef707660d439a299,6f97bd74af6106a1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-agent-status3,ef707660d439a299,10e25e3a9c233dd0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-agent-status4,ef707660d439a299,79d7e080327319c9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-agent-status5,ef707660d439a299,3a99d8868bf93457] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:00:29.945 INFO 9 --- [host-check-agent-status6,ef707660d439a299,6d8bf6314c7bcfb2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:00:29.946 INFO 9 --- [ocp-schedules-26,c58ff3f5dc07f753,c20b3ad3c1a893af] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:29.946 INFO 9 --- [host-check-clockdiff1,c58ff3f5dc07f753,5709b738ff3b7c3a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:00:29.946 INFO 9 --- [host-check-clockdiff2,c58ff3f5dc07f753,7a779706f82830d5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:00:29.946 INFO 9 --- [host-check-clockdiff3,c58ff3f5dc07f753,ed0fa8c6f103d246] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:00:29.946 INFO 9 --- [host-check-clockdiff4,c58ff3f5dc07f753,3a53eebc0e1ddcd4] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:00:29.946 INFO 9 --- [host-check-clockdiff5,c58ff3f5dc07f753,b1cd03af6f6c1160] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:00:29.947 INFO 9 --- [host-check-clockdiff6,c58ff3f5dc07f753,ac26c60047584fe6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:00:29.948 INFO 9 --- [ocp-schedules-3,cb9067af93baa404,162a198f22afb3e8] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:00:29.952 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:29.953 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:29.953 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:29.953 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:29.953 INFO 9 --- [host-check-clockdiff2,c58ff3f5dc07f753,7a779706f82830d5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002429 -1 -1 , error= 2025-09-16 14:00:29.953 INFO 9 --- [host-check-clockdiff1,c58ff3f5dc07f753,5709b738ff3b7c3a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002429 -1 -1 , error= 2025-09-16 14:00:29.955 INFO 9 --- [host-check-agent-status3,ef707660d439a299,10e25e3a9c233dd0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:29.955 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:29.955 INFO 9 --- [host-check-agent-status2,ef707660d439a299,6f97bd74af6106a1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:29.955 INFO 9 --- [host-check-agent-status6,ef707660d439a299,6d8bf6314c7bcfb2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:29.955 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:29.955 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:29.955 INFO 9 --- [host-check-clockdiff3,c58ff3f5dc07f753,ed0fa8c6f103d246] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002429 -1 -1 , error= 2025-09-16 14:00:29.955 INFO 9 --- [host-check-clockdiff5,c58ff3f5dc07f753,b1cd03af6f6c1160] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002429 -1 -1 , error= 2025-09-16 14:00:29.955 INFO 9 --- [host-check-clockdiff6,c58ff3f5dc07f753,ac26c60047584fe6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002429 -1 -1 , error= 2025-09-16 14:00:29.956 INFO 9 --- [host-check-agent-status4,ef707660d439a299,79d7e080327319c9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:29.956 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:29.956 INFO 9 --- [host-check-agent-status1,ef707660d439a299,a412e0d2c2b0a95a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:29.956 INFO 9 --- [host-check-agent-status5,ef707660d439a299,3a99d8868bf93457] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:29.956 INFO 9 --- [host-check-agent-status3,ef707660d439a299,10e25e3a9c233dd0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:29.956 INFO 9 --- [host-check-clockdiff4,c58ff3f5dc07f753,3a53eebc0e1ddcd4] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002429 -1 -1 , error= 2025-09-16 14:00:29.956 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:29.956 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:29.956 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:29.956 INFO 9 --- [host-check-agent-status2,ef707660d439a299,6f97bd74af6106a1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:29.956 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:29.957 INFO 9 --- [host-check-agent-status4,ef707660d439a299,79d7e080327319c9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:29.957 INFO 9 --- [host-check-agent-status6,ef707660d439a299,6d8bf6314c7bcfb2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:29.957 INFO 9 --- [host-check-agent-status1,ef707660d439a299,a412e0d2c2b0a95a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:29.957 INFO 9 --- [host-check-agent-status5,ef707660d439a299,3a99d8868bf93457] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:29.962 INFO 9 --- [ocp-schedules-14,6a7a7f23de80ae12,bf131c5ca593e7a0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 14:00:29.963 INFO 9 --- [ocp-schedules-2,1f57f0b59ad4b446,4c7984d3b1298649] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 14:00:29.968 INFO 9 --- [ocp-schedules-14,6a7a7f23de80ae12,bf131c5ca593e7a0] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 14:00:29.969 INFO 9 --- [ocp-schedules-2,1f57f0b59ad4b446,4c7984d3b1298649] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 14:00:29.970 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:00:29.970 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:00:29.970 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:00:29.970 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:00:29.970 INFO 9 --- [host-check-agent-status3,ef707660d439a299,10e25e3a9c233dd0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:00:29.970 INFO 9 --- [host-check-agent-status2,ef707660d439a299,6f97bd74af6106a1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:00:29.970 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:00:29.971 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:00:29.971 INFO 9 --- [host-check-agent-status4,ef707660d439a299,79d7e080327319c9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:00:29.971 INFO 9 --- [host-check-agent-status6,ef707660d439a299,6d8bf6314c7bcfb2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:00:29.970425668+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:00:29.970502934+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:00:29.971056439+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:00:29.970663036+08:00 2025-09-16 14:00:29.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:29.972 INFO 9 --- [host-check-agent-status5,ef707660d439a299,3a99d8868bf93457] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:00:29.972+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:00:29.972+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:00:29.972+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:00:29.971445144+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:00:29.972+08:00 2025-09-16 14:00:29.972 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:00:29.971678174+08:00 2025-09-16 14:00:29.973 INFO 9 --- [host-check-agent-status1,ef707660d439a299,a412e0d2c2b0a95a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:00:29.973 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:00:29.972+08:00 2025-09-16 14:00:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:29.973 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:00:29.973+08:00 2025-09-16 14:00:29.973 INFO 9 --- [host-check-agent-status3,ef707660d439a299,10e25e3a9c233dd0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:00:29.973 INFO 9 --- [host-check-agent-status3,ef707660d439a299,10e25e3a9c233dd0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:00:29.973 INFO 9 --- [host-check-agent-status3,ef707660d439a299,10e25e3a9c233dd0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:00:29.974 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:00:29.972+08:00 and status AVAILABLE 2025-09-16 14:00:29.974 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:00:29.972+08:00 and status AVAILABLE 2025-09-16 14:00:29.974 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:00:29.972+08:00 and status AVAILABLE 2025-09-16 14:00:29.974 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:00:29.972+08:00 and status AVAILABLE 2025-09-16 14:00:29.974 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:00:29.972+08:00 and status AVAILABLE 2025-09-16 14:00:29.974 INFO 9 --- [host-check-agent-status2,ef707660d439a299,6f97bd74af6106a1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:00:29.974 INFO 9 --- [host-check-agent-status2,ef707660d439a299,6f97bd74af6106a1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:00:29.974 INFO 9 --- [host-check-agent-status2,ef707660d439a299,6f97bd74af6106a1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:00:29.975 INFO 9 --- [host-check-agent-status5,ef707660d439a299,3a99d8868bf93457] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:00:29.975 INFO 9 --- [host-check-agent-status5,ef707660d439a299,3a99d8868bf93457] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:00:29.975 INFO 9 --- [host-check-agent-status5,ef707660d439a299,3a99d8868bf93457] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:00:29.975 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:00:29.973+08:00 and status AVAILABLE 2025-09-16 14:00:29.975 INFO 9 --- [host-check-agent-status6,ef707660d439a299,6d8bf6314c7bcfb2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:00:29.975 INFO 9 --- [host-check-agent-status6,ef707660d439a299,6d8bf6314c7bcfb2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:00:29.975 INFO 9 --- [host-check-agent-status6,ef707660d439a299,6d8bf6314c7bcfb2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:00:29.976 INFO 9 --- [host-check-agent-status1,ef707660d439a299,a412e0d2c2b0a95a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:00:29.976 INFO 9 --- [host-check-agent-status1,ef707660d439a299,a412e0d2c2b0a95a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:00:29.976 INFO 9 --- [host-check-agent-status1,ef707660d439a299,a412e0d2c2b0a95a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:00:29.977 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:00:29.977 INFO 9 --- [host-check-agent-status4,ef707660d439a299,79d7e080327319c9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:00:29.977 INFO 9 --- [host-check-agent-status4,ef707660d439a299,79d7e080327319c9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:00:29.977 INFO 9 --- [host-check-agent-status4,ef707660d439a299,79d7e080327319c9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:00:29.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:00:29.978 INFO 9 --- [ocp-schedules-16,2629d51ea2a480ef,5ad6af08eae3576a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:00:29.978 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:00:29.978 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:00:29.978 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:00:29.978 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:00:29.978 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:00:29.983 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:29.984 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:29.984 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:29.984 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:29.984 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:29.984 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:29.984 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:29.985 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:29.985 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:29.985 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:29.985 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:29.985 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:29.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:00:29.998 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:29.999 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:29.999 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:29.999 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:29.999 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:29.999 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:30.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:00:30.003217+08:00, lastProcessTime=2025-09-16T14:00:20.003410+08:00 2025-09-16 14:00:30.026 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:30.026 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:00:30.026 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:00:30.026 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:00:30.026 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:00:30.027 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:00:30.027 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:30.028 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:00:30.031 INFO 9 --- [ocp-schedules-15,60405d150641f080,bb7c417b63883adb] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":10006} 2025-09-16 14:00:30.031 INFO 9 --- [ocp-schedules-15,60405d150641f080,bb7c417b63883adb] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:00:30.032 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:00:30.032 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:00:30.033 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:00:30.033 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:00:30.034 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:00:30.034 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:00:30.040 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:00:30.044 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:30.046 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:30.046 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:30.046 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:30.046 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:30.053 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:00:30.062 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:30.063 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:30.064 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:00:30.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:30.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:00:30.071 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:30.072 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:00:30.073 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:00:30.074 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:00:30.074 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:00:30.074 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:00:30.078 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:00:30.080 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:00:30.080 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:00:30.080 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:00:30.081 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:00:30.081 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:00:30.085 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.085 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:30.087 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:00:30.090 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:30.091 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:30.092 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:30.093 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:30.094 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:30.098 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:00:30.101 INFO 9 --- [prometheus-second-schedule-1,a81a178bb39b579f,b6e9f53ecc7ff347] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 14:00:30.102 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.102 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:30.114 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.114 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:30.118 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:00:30.119 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:00:30.121 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:00:30.124 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:00:30.124 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:00:30.125 INFO 9 --- [host-check-host-status5,6204575d5d247367,cc373740109f9e19] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:00:30.126 INFO 9 --- [host-check-host-status2,6204575d5d247367,d19525761236125b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:00:30.127 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:00:30.127 INFO 9 --- [host-check-host-status3,6204575d5d247367,af4b5d36e7c2ec5e] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:00:30.130 INFO 9 --- [host-check-host-status1,6204575d5d247367,cc7b508b377a8cb2] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:00:30.130 INFO 9 --- [host-check-host-status6,6204575d5d247367,4fe75e7e4df3dbc1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:00:30.131 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.131 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:30.133 INFO 9 --- [host-check-host-status4,6204575d5d247367,68f20520e8e33a6a] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:00:30.135 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:00:30.003217+08:00 2025-09-16 14:00:30.145 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.145 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:30.159 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.159 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:30.185 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.185 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:00:30.188 INFO 9 --- [ocp-async-2,5cccee3578b6e843,89cdd75da257a692] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:00:30.199 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.199 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:00:30.214 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:00:30.227 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:30.229 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:30.230 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:30.235 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:00:30.237 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:00:30.240 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:30.241 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:30.254 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:00:30.281 INFO 9 --- [ocp-schedules-23,521644c606818b9b,3ba2327b36ff5dea] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 14:00:30.282 INFO 9 --- [ocp-schedules-23,521644c606818b9b,3ba2327b36ff5dea] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:30.283 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 14:00:30.283 INFO 9 --- [ocp-schedules-23,521644c606818b9b,3ba2327b36ff5dea] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:00:30.289 INFO 9 --- [ocp-schedules-13,75c2383336720ee5,edc01215f8f06686] c.o.o.s.common.scheduled.HostSchedules : Check host version schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:30.289 INFO 9 --- [ocp-schedules-13,75c2383336720ee5,edc01215f8f06686] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-version, skip execute 2025-09-16 14:00:30.316 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:00:30.330 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:30.331 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:30.332 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:00:30.346 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:00:30.346 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:00:30.346 INFO 9 --- [ocp-schedules-21,371057fac82a6cfc,140bb3b02d5d7bdd] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:00:30.413 INFO 9 --- [ocp-schedules-7,d5527cfeee50abbd,d692361cb4fd6f6d] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 14:00:30.602 INFO 9 --- [ocp-schedules-29,d26c15f788772731,46d7aef86bd3ed36] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 14:00:30.604 INFO 9 --- [ocp-schedules-29,d26c15f788772731,46d7aef86bd3ed36] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 14:00:30.604 INFO 9 --- [ocp-schedules-29,d26c15f788772731,46d7aef86bd3ed36] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 14:00:30.607 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:30.608 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:30.813 WARN 9 --- [ocp-async-3,2bc912509a7e6d89,29b8da2cfbc88b3a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:30.813 INFO 9 --- [ocp-async-7,9c04fd9c6862d915,74371b123444344b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:30.871 INFO 9 --- [ocp-schedules-20,8aa51fc9f02196f7,a3ac7c1beef6bf90] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:00:30.997 INFO 9 --- [ocp-schedules-9,f206bfbcfebd3761,7acb252863c611cc] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 14:00:30.997 INFO 9 --- [ocp-schedules-9,f206bfbcfebd3761,7acb252863c611cc] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 14:00:31.506 INFO 9 --- [ocp-schedules-13,b90d5261e96e649e,3049865c03d2b852] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 14:00:31.506 INFO 9 --- [ocp-schedules-13,b90d5261e96e649e,3049865c03d2b852] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002431 2025-09-16 14:00:31.507 INFO 9 --- [ocp-schedules-13,b90d5261e96e649e,3049865c03d2b852] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 14:00:31.636 INFO 9 --- [prometheus-minute-schedule-1,83c900b3d350ce35,b458e9bbd0a0dac2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:31.639 INFO 9 --- [prometheus-minute-schedule-1,83c900b3d350ce35,b458e9bbd0a0dac2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:31.682 INFO 9 --- [ocp-schedules-21,34b6467c99b0e8d6,dbe449a4304cf216] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 14:00:31.719 INFO 9 --- [ocp-schedules-28,a5e644ba830e8cb4,c64c4488a49f2521] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 14:00:31.719 INFO 9 --- [ocp-schedules-28,a5e644ba830e8cb4,c64c4488a49f2521] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 14:00:31.719 INFO 9 --- [ocp-schedules-28,a5e644ba830e8cb4,c64c4488a49f2521] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 14:00:31.719 INFO 9 --- [ocp-schedules-28,a5e644ba830e8cb4,c64c4488a49f2521] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 14:00:31.720 INFO 9 --- [ocp-schedules-28,a5e644ba830e8cb4,c64c4488a49f2521] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 14:00:31.720 INFO 9 --- [ocp-schedules-28,a5e644ba830e8cb4,c64c4488a49f2521] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 14:00:31.740 INFO 9 --- [ocp-schedules-7,874abd5c82e26390,09622bf02e2eb166] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 14:00:31.812 INFO 9 --- [ocp-schedules-3,a9e991ee64d43fa5,c2d9e323e17a7789] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 14:00:31.813 INFO 9 --- [ocp-schedules-3,a9e991ee64d43fa5,c2d9e323e17a7789] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:31.825 INFO 9 --- [ocp-schedules-2,e5e5f12d69fb60a3,1d268a4401dd6e0c] c.o.o.s.common.scheduled.PerfSchedules : Collect high risk sql audit stat, time=2025-09-16T14:00:31.825+08:00, tenantSize=3 2025-09-16 14:00:31.829 INFO 9 --- [ocp-schedules-2,e5e5f12d69fb60a3,1d268a4401dd6e0c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2currentTimeUs:1758002431825000 2025-09-16 14:00:31.829 INFO 9 --- [ocp-schedules-2,e5e5f12d69fb60a3,1d268a4401dd6e0c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2diagnosisStartTimeUs:1758002131782000 2025-09-16 14:00:31.831 INFO 9 --- [ocp-schedules-3,a9e991ee64d43fa5,c2d9e323e17a7789] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 14:00:31.844 INFO 9 --- [ocp-schedules-2,e5e5f12d69fb60a3,1d268a4401dd6e0c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_2totalLength:0 2025-09-16 14:00:31.849 INFO 9 --- [ocp-schedules-2,e5e5f12d69fb60a3,1d268a4401dd6e0c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3currentTimeUs:1758002431846000 2025-09-16 14:00:31.849 INFO 9 --- [ocp-schedules-2,e5e5f12d69fb60a3,1d268a4401dd6e0c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3diagnosisStartTimeUs:1758002131802000 2025-09-16 14:00:31.863 INFO 9 --- [ocp-schedules-2,e5e5f12d69fb60a3,1d268a4401dd6e0c] c.o.o.p.s.i.HighRiskSqlInspectService : taskName:high_risk_sql_audit_diag_1_3totalLength:0 2025-09-16 14:00:32.214 INFO 9 --- [ocp-schedules-15,5c04423106dd2711,754a9ae9ce605745] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:00:32.219 WARN 9 --- [scanner-1387097-1,5c04423106dd2711,99e3bd0c15a84c48] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:00:32.814 WARN 9 --- [ocp-async-2,2bd72ac4e6370325,9a800b46913ab5d4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:32.814 INFO 9 --- [ocp-async-9,e556afa199cb09a7,2b07a62311853d12] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:33.511 INFO 9 --- [ocp-schedules-24,7cab562971588b54,d2c2b34a7cce23e4] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 14:00:33.608 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:33.608 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:33.649 INFO 9 --- [ocp-schedules-9,f61ca0684c6571bb,da382b356d9daaf2] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T14:00:33.649+08:00, clusters=[1] 2025-09-16 14:00:33.651 INFO 9 --- [ocp-schedules-9,f61ca0684c6571bb,da382b356d9daaf2] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 14:00:34.221 INFO 9 --- [ocp-schedules-11,6958a10b2948e6b0,d1abeadb44e84f39] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 14:00:34.221 INFO 9 --- [ocp-schedules-11,6958a10b2948e6b0,d1abeadb44e84f39] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 14:00:34.222 INFO 9 --- [ocp-schedules-11,6958a10b2948e6b0,d1abeadb44e84f39] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 14:00:34.237 INFO 9 --- [ocp-schedules-11,6958a10b2948e6b0,d1abeadb44e84f39] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 14:00:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 14:00:34.636 INFO 9 --- [prometheus-minute-schedule-1,0c8e5fdf892790d2,a303656509b9ed7a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:34.639 INFO 9 --- [prometheus-minute-schedule-1,0c8e5fdf892790d2,a303656509b9ed7a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:34.774 INFO 9 --- [ocp-schedules-17,7cda6d6a3cdedfd7,3d6bc30f1f4a2257] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:00:34.779 INFO 9 --- [ocp-schedules-17,7cda6d6a3cdedfd7,3d6bc30f1f4a2257] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:00:34.779 INFO 9 --- [ocp-schedules-17,7cda6d6a3cdedfd7,3d6bc30f1f4a2257] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:00:34.814 WARN 9 --- [ocp-async-5,f96c9bed1e89522a,d869a1e525b886e5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:34.814 INFO 9 --- [ocp-async-1,d26c830490498311,e8fd941c581a0a25] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:34.894 INFO 9 --- [ocp-schedules-2,7b1a875d39da0946,4b8e569b0489212e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:00:35.808 INFO 9 --- [ocp-schedules-4,68e3cffaa68d580c,eb7f554c3537be79] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T14:00:35.808+08:00, clusters=[1] 2025-09-16 14:00:35.839 INFO 9 --- [ocp-schedules-4,68e3cffaa68d580c,eb7f554c3537be79] c.o.o.p.s.i.alarm.SlowSqlDataSource : collect SlowSqlData for zhengqi, save 1 to SqlAggregateData 2025-09-16 14:00:36.105 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:36.105 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=10 2025-09-16 14:00:36.106 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=8 2025-09-16 14:00:36.106 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=7 2025-09-16 14:00:36.106 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=12 2025-09-16 14:00:36.106 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=9 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_retry_remove_parts, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_fail_check_localserver, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_mem_alloc_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_server_hang_due_to_trx_lock, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_rootservice_stop_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_parse_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_refresh_schema_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_alloc_oops, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_invalid_lock, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_assemble_rpc_lock, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_global_trans_version_delay, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_server_local_ip_invalid, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_common_unexpected_internal_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clock_unsync, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_major_freeze_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_distributed_strong_read, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_reply_memstore_failed, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_rootservice_start_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_write_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType rootservice_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_error_lib_direct_alloc, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_merge_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_fetch_rs_url_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_partition_overlimit, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_rootservice_destroy_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_max_open_files, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_worker_thread_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_mysql_request_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_trx_context_not_release, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_checksum_mismatch, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_replica_minority, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_unknown_checksum_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_online_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_no_valid_parti, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_meta_inconsistent, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rpc_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_network_unreachable, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_tx_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_too_many_sstables, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_right_to_die, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_cant_daily_merge, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_voting_success, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_virtual_group_elect_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_thread_hang, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_microblock_read0, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_merge_error_4184, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_dump_queue_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType election_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_unit_migrate_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_commit_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_easy_hold_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_row_count_notsame, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_restart_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_io_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_server_disk_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_merge_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType observer_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_disk_almost_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_timer_cost_much, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clog_disk_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_decent_voting, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_get_events_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rs_checksum_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rpc_blocklist, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_clock_diff_time_too_large, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_server_service_start_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_system_disk_full, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType refresh_location_cache_failed, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_crash_error, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_ps_checksum_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_rpc_fly_slow, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_err_defensive_check, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_log_renew_location_timeout, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.140 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType ob_server_stop_fail, alarm targets do not contain hostIp 192.168.0.46 2025-09-16 14:00:36.142 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 7 agent sql collect property 2025-09-16 14:00:36.142 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:36.144 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:36.158 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.85 2025-09-16 14:00:36.158 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.85 2025-09-16 14:00:36.158 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.85 2025-09-16 14:00:36.158 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.104 2025-09-16 14:00:36.158 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.104 2025-09-16 14:00:36.158 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.104 2025-09-16 14:00:36.159 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.54 2025-09-16 14:00:36.159 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.54 2025-09-16 14:00:36.159 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.159 2025-09-16 14:00:36.159 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.54 2025-09-16 14:00:36.159 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.159 2025-09-16 14:00:36.159 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 9 agent sql collect property 2025-09-16 14:00:36.159 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.159 2025-09-16 14:00:36.160 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 10 agent sql collect property 2025-09-16 14:00:36.160 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (logtailer.log.filter.rules.json.content=[{"alarmTemplateId":0,"alarmType":"message_hardware_error","durationSeconds":0,"evaluationIntervalSeconds":0,"excludeKeywords":[],"excludeKeywordsRelation":"Or","expression":{"metric":"os_message_log"},"expressionType":"Log","includeKeywords":["Hardware Error"],"includeKeywordsRelation":"Or","level":2,"logLevels":[],"resolvedTimeoutSeconds":300},{"alarmTemplateId":0,"alarmType":"message_log_alarm","durationSeconds":0,"evaluationIntervalSeconds":0,"excludeKeywords":[],"excludeKeywordsRelation":"Or","expression":{"metric":"os_message_log"},"expressionType":"Log","includeKeywords":["kernel: nvme.*timeout"],"includeKeywordsRelation":"Or","level":2,"logLevels":[],"resolvedTimeoutSeconds":300},{"alarmTemplateId":0,"alarmType":"odp_instance_compress_failed","durationSeconds":0,"evaluationIntervalSeconds":60,"excludeKeywords":[],"expression":{"metric":"instance_compress_failed_count","op":">","threshold":0.00},"expressionType":"LogStat","includeKeywords":[],"level":2,"logLevels":[],"resolvedTimeoutSeconds":300},{"alarmTemplateId":0,"alarmType":"odp_instance_expanse_failed","durationSeconds":0,"evaluationIntervalSeconds":60,"excludeKeywords":[],"expression":{"metric":"instance_expanse_failed_count","op":">","threshold":0.00},"expressionType":"LogStat","includeKeywords":[],"level":2,"logLevels":[],"resolvedTimeoutSeconds":300}]), (monagent.pipeline.ob.trace.status=inactive), (monagent.pipeline.ob.log.status=inactive)]), params:null 2025-09-16 14:00:36.161 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 8 agent sql collect property 2025-09-16 14:00:36.161 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 12 agent sql collect property 2025-09-16 14:00:36.168 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:36.169 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:36.170 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:36.170 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:36.170 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:36.171 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:36.171 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:36.171 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:36.176 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 7, do nothing 2025-09-16 14:00:36.177 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Refreshing OCP agent configuration: hostId=11 2025-09-16 14:00:36.189 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone4), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.85), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.85:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_log. 2025-09-16 14:00:36.190 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone3), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.104), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.104:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_l 2025-09-16 14:00:36.190 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone5), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.54), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.54:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_log. 2025-09-16 14:00:36.191 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone1), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.159), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.159:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_l 2025-09-16 14:00:36.208 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 9, do nothing 2025-09-16 14:00:36.209 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 12, do nothing 2025-09-16 14:00:36.209 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 10, do nothing 2025-09-16 14:00:36.215 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 8, do nothing 2025-09-16 14:00:36.226 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_query_slow, alarm targets do not contain hostIp 192.168.0.111 2025-09-16 14:00:36.226 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType odp_sql_execute_failed, alarm targets do not contain hostIp 192.168.0.111 2025-09-16 14:00:36.226 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.alarm.service.OcpAlarmRuleService : alarmType obproxy_log_alarm, alarm targets do not contain hostIp 192.168.0.111 2025-09-16 14:00:36.227 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] o.p.s.i.SqlCollectHostPropertiesProvider : start to set hostId 11 agent sql collect property 2025-09-16 14:00:36.236 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:36.238 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:36.258 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/module/config/update, request body:UpdateAgentConfigRequest(agentHome=null, configs=[(ocp.agent.snapshot.maxsize=1GB), (ocp.agent.snapshot.maxage.days=90), (agent.http.basic.auth.metricAuthEnabled=true), (monagent.second.metric.cache.update.interval=15s), (monagent.log.level=info), (ocp.agent.collect.snapshot.status=active), (mgragent.log.level=info), (monagent.ob.zone.name=zone2), (ob.logcleaner.ob_log.rule1.file.regex=([a-z]+.)?[a-z]+.log.wf.[0-9]+), (monagent.ob.err.code.prefix=errcode=-), (monagent.ob.cgroup.status=active), (monagent.pipeline.ob.status=active), (ob.run.user=admin), (monagent.monitordb.host=192.168.0.46), (ob.logcleaner.ob_log.rule0.retention.days=8), (ob.sync.status=VALID), (monagent.ob.cluster.id=1), (ob.logcleaner.ob_log.disk.threshold=80), (ob.logcleaner.ob_log.rule2.file.regex=[a-z]+.log.[0-9]+.zst), (monagent.monitordb.mysql.address=tcp(192.168.0.46:2881)), (ob.logcleaner.ob_log.rule1.keep.percentage=80), (ob.logcleaner.core_log.rule0.keep.percentage=60), (monagent.monitordb.password=xxx (monagent.monitordb.database=ocp_monitor), (monagent.ob.rpc.port=2882), (ob.logcleaner.core_log.disk.threshold=80), (monagent.host.ip=192.168.0.111), (ob.run.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule2.keep.percentage=80), (ob.install.path=/home/admin/oceanbase), (ob.logcleaner.ob_log.rule1.retention.days=30), (ob.logcleaner.core_log.rule0.file.regex=core.[0-9]+), (ob.data.path=/data/oceanbase/data), (monagent.cluster.id=1), (monagent.ob.sql.port=2881), (monagent.monitordb.port=2881), (monagent.ob.monitor.password=xxx (ob.log.path=/data/oceanbase/log), (ob.logcleaner.enabled=true), (ob.logcleaner.core_log.rule0.retention.days=8), (monagent.pipeline.awr.collect.disabled=true), (monagent.ob.monitor.mysql.address=tcp(192.168.0.111:2881)), (ob.logcleaner.ob_log.rule0.file.regex=[a-z]+.[a-z]+.log.[0-9]+), (ob.logcleaner.ob_log.rule0.keep.percentage=60), (monagent.ob.cluster.name=zhengqi), (ob.logtailer.enabled=true), (ob.logcleaner.ob_l 2025-09-16 14:00:36.276 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.AgentConfigChangeServiceImpl : no change for host 11, do nothing 2025-09-16 14:00:36.277 INFO 9 --- [ocp-schedules-3,fa4691cc781f091d,b821537fc7b92077] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config finished 2025-09-16 14:00:36.608 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:36.609 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:36.814 WARN 9 --- [ocp-async-4,25d58d6a9c683b7d,221cca531045ad38] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:36.814 INFO 9 --- [ocp-async-10,e33175eba62f1aff,7962dbdf10647d3c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:37.636 INFO 9 --- [prometheus-minute-schedule-1,5ef3aee1026b78ed,c1775ba77e632404] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:37.639 INFO 9 --- [prometheus-minute-schedule-1,5ef3aee1026b78ed,c1775ba77e632404] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:38.016 INFO 9 --- [ocp-schedules-5,a223513d8eed4a1b,34aeccaa3c6d0a01] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 14:00:38.017 INFO 9 --- [ocp-schedules-5,a223513d8eed4a1b,34aeccaa3c6d0a01] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:38.037 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:38.037 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 14:00:38.050 INFO 9 --- [ocp-schedules-5,a223513d8eed4a1b,34aeccaa3c6d0a01] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 14:00:38.814 WARN 9 --- [ocp-async-2,c0537d475f377dbe,80e068203bddb71d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:38.814 INFO 9 --- [ocp-async-8,105cb72da011be91,0888ebf383818ee5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:39.308 INFO 9 --- [ocp-schedules-6,2bb34e5390c699c6,6cf7bd602b1369f4] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:00:39.310 INFO 9 --- [ocp-schedules-6,2bb34e5390c699c6,6cf7bd602b1369f4] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:00:39.400 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2025-09-16 14:00:39.400 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2025-09-16 14:00:39.401 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.401 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:39.403 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.403 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.403 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.404 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2025-09-16 14:00:39.409 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.409 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.410 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.410 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_cache_info 2025-09-16 14:00:39.414 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2025-09-16 14:00:39.414 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2025-09-16 14:00:39.415 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.416 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:39.417 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.418 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.418 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.418 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2025-09-16 14:00:39.429 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.429 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.430 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.430 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_0 2025-09-16 14:00:39.440 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.441 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.441 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.442 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2025-09-16 14:00:39.451 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.452 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.452 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.452 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_1 2025-09-16 14:00:39.462 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.462 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.463 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.463 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2025-09-16 14:00:39.473 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.473 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.474 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.474 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_stat_2 2025-09-16 14:00:39.484 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.484 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.484 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.485 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2025-09-16 14:00:39.494 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.495 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.495 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.495 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2025-09-16 14:00:39.501 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.501 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.502 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.502 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sqltext 2025-09-16 14:00:39.508 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.509 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.509 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.509 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_dynamic_sql 2025-09-16 14:00:39.514 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.514 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.515 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.515 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_high_risk_sql 2025-09-16 14:00:39.520 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.520 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.520 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.521 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2025-09-16 14:00:39.526 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.527 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.527 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.527 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_stat_0 2025-09-16 14:00:39.533 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.533 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.534 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.534 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2025-09-16 14:00:39.539 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.539 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.540 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.540 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan 2025-09-16 14:00:39.545 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.546 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.546 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.546 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2025-09-16 14:00:39.551 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.552 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.552 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.552 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_plan_cache_plan_explain 2025-09-16 14:00:39.557 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.558 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.558 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.559 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2025-09-16 14:00:39.566 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.566 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.566 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.567 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_v2_sql_audit_sample 2025-09-16 14:00:39.574 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.574 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.575 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.575 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample_statistics 2025-09-16 14:00:39.583 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.584 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.584 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.584 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2025-09-16 14:00:39.589 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.590 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.590 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.590 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2025-09-16 14:00:39.596 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.596 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.596 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.597 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2025-09-16 14:00:39.601 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.602 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.602 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.603 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2025-09-16 14:00:39.607 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.607 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.608 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.608 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2025-09-16 14:00:39.609 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:39.610 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:39.613 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.613 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.613 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.614 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2025-09-16 14:00:39.618 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.619 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.619 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.619 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2025-09-16 14:00:39.624 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.624 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.625 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.625 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2025-09-16 14:00:39.630 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.630 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.630 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.631 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2025-09-16 14:00:39.635 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.636 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.636 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.636 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2025-09-16 14:00:39.641 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.641 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.642 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.642 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2025-09-16 14:00:39.647 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.647 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.648 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.648 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2025-09-16 14:00:39.653 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.653 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.653 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.654 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2025-09-16 14:00:39.658 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.658 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.659 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.659 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2025-09-16 14:00:39.664 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.664 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.664 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.665 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2025-09-16 14:00:39.670 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.670 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.670 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.671 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2025-09-16 14:00:39.675 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.676 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.676 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.676 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2025-09-16 14:00:39.681 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.681 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.682 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.682 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2025-09-16 14:00:39.687 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.687 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.687 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.688 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2025-09-16 14:00:39.692 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.693 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.693 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.693 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_memory 2025-09-16 14:00:39.698 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.698 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.699 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.699 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_hit 2025-09-16 14:00:39.704 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.704 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.705 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.705 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2025-09-16 14:00:39.711 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.712 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.712 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.712 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_v2 2025-09-16 14:00:39.718 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.718 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.718 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.719 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2025-09-16 14:00:39.723 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.723 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.724 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.724 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_server_event 2025-09-16 14:00:39.728 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.728 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.728 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.729 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2025-09-16 14:00:39.733 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.733 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.733 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.734 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2025-09-16 14:00:39.738 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.738 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.739 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.739 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2025-09-16 14:00:39.743 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.743 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.744 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.744 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2025-09-16 14:00:39.748 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.748 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.749 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.749 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2025-09-16 14:00:39.753 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.754 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.754 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.754 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2025-09-16 14:00:39.759 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.759 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.760 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.760 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2025-09-16 14:00:39.764 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.765 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.766 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.767 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2025-09-16 14:00:39.771 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.771 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.772 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.772 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_async 2025-09-16 14:00:39.776 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.776 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.777 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.777 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2025-09-16 14:00:39.780 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.780 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.781 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.781 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2025-09-16 14:00:39.785 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.786 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:39.786 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:39.786 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2025-09-16 14:00:39.789 INFO 9 --- [ocp-schedules-3,eb56b01bbd439b9c,0436e9f443dcb6aa] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2025-09-16 14:00:40.002 INFO 9 --- [ocp-schedules-27,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 14:00:40.002 INFO 9 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 14:00:40.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:00:40.002928+08:00, lastProcessTime=2025-09-16T14:00:30.003217+08:00 2025-09-16 14:00:40.119 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:00:40.002928+08:00 2025-09-16 14:00:40.133 INFO 9 --- [ocp-schedules-4,67f5e788f1e49460,3c577e657f234331] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 14:00:40.133 INFO 9 --- [ocp-schedules-4,67f5e788f1e49460,3c577e657f234331] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 14:00:40.137 INFO 9 --- [ocp-schedules-11,53b4052ccdaaf266,a451e787e2ab499a] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:40.137 INFO 9 --- [ocp-schedules-11,53b4052ccdaaf266,a451e787e2ab499a] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 14:00:40.137 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 14:00:40.138 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 14:00:40.138 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 14:00:40.138 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 14:00:40.141 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:40.141 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:40.141 INFO 9 --- [ocp-schedules-11,53b4052ccdaaf266,a451e787e2ab499a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:40.141 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:40.141 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:40.142 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:40.142 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:40.142 INFO 9 --- [ocp-schedules-11,53b4052ccdaaf266,a451e787e2ab499a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:40.142 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:40.142 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:40.149 INFO 9 --- [Collect all tenants major compactions1,67f5e788f1e49460,a72c54db8aaa02e1] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 14:00:40.149 INFO 9 --- [Collect all tenants major compactions2,67f5e788f1e49460,c7283f8844981b35] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:00:40.149 INFO 9 --- [Collect all tenants major compactions3,67f5e788f1e49460,35841f8edb73270e] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 14:00:40.156 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 14:00:40.156 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 14:00:40.157 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 14:00:40.157 INFO 9 --- [ocp-schedules-11,53b4052ccdaaf266,a451e787e2ab499a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 14:00:40.157 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 14:00:40.157 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 14:00:40.161 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:40.162 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:40.169 INFO 9 --- [Collect all tenants major compactions1,67f5e788f1e49460,a72c54db8aaa02e1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:40.169 INFO 9 --- [Collect all tenants major compactions3,67f5e788f1e49460,35841f8edb73270e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:40.169 INFO 9 --- [Collect all tenants major compactions2,67f5e788f1e49460,c7283f8844981b35] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:40.170 INFO 9 --- [Collect all tenants major compactions2,67f5e788f1e49460,c7283f8844981b35] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 14:00:40.171 INFO 9 --- [Collect all tenants major compactions1,67f5e788f1e49460,a72c54db8aaa02e1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 14:00:40.171 INFO 9 --- [Collect all tenants major compactions3,67f5e788f1e49460,35841f8edb73270e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 14:00:40.173 INFO 9 --- [Collect all tenants major compactions2,67f5e788f1e49460,c7283f8844981b35] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:00:40.175 INFO 9 --- [Collect all tenants major compactions3,67f5e788f1e49460,35841f8edb73270e] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:00:40.175 INFO 9 --- [Collect all tenants major compactions1,67f5e788f1e49460,a72c54db8aaa02e1] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:00:40.176 INFO 9 --- [ocp-schedules-4,67f5e788f1e49460,3c577e657f234331] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 14:00:40.177 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 14:00:40.178 INFO 9 --- [ocp-schedules-11,53b4052ccdaaf266,a451e787e2ab499a] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 14:00:40.188 INFO 9 --- [ocp-async-4,e4c3871aad4925d1,f8def3ac6dbb92d8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:00:40.636 INFO 9 --- [prometheus-minute-schedule-1,d8d1cd00b6b3cfd5,521e639abd706d04] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:40.639 INFO 9 --- [prometheus-minute-schedule-1,d8d1cd00b6b3cfd5,521e639abd706d04] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:40.814 WARN 9 --- [ocp-async-6,cfa42739058469e4,4f7a5344ce9b277e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:40.814 INFO 9 --- [ocp-async-4,b8b149f178e61710,b6fbd34a4d55b1c7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:42.242 INFO 9 --- [ocp-schedules-23,69713667f8a655db,05b60a882d620516] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:00:42.247 WARN 9 --- [scanner-1387223-1,69713667f8a655db,5256392d6a307ffe] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:00:42.257 INFO 9 --- [alarm-detect-16,69713667f8a655db,e935d263da16fd24] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 37, data is empty. 2025-09-16 14:00:42.259 INFO 9 --- [alarm-detect-7,69713667f8a655db,df3b02dd8274d227] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 37, data is empty. 2025-09-16 14:00:42.261 INFO 9 --- [alarm-detect-11,69713667f8a655db,40be4430ea794e3d] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 37, data is empty. 2025-09-16 14:00:42.272 INFO 9 --- [alarm-detect-9,69713667f8a655db,c2d07e0847788e6a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 37, data is empty. 2025-09-16 14:00:42.610 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:42.610 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:42.670 INFO 9 --- [ocp-schedules-26,1dd2286053460f7d,c9c30c198bc383f1] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 14:00:42.670 INFO 9 --- [ocp-schedules-26,1dd2286053460f7d,c9c30c198bc383f1] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 14:00:42.708 INFO 9 --- [ocp-schedules-26,1dd2286053460f7d,c9c30c198bc383f1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:42.709 INFO 9 --- [ocp-schedules-26,1dd2286053460f7d,c9c30c198bc383f1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 14:00:42.814 WARN 9 --- [ocp-async-3,6b375edb82af3c9c,ca05a2649dab5c27] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:42.814 INFO 9 --- [ocp-async-2,6c7fca53f3d4d025,145fb3c4060ca72d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:43.636 INFO 9 --- [prometheus-minute-schedule-1,3e6216977f18419e,53abec64322ac862] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:43.639 INFO 9 --- [prometheus-minute-schedule-1,3e6216977f18419e,53abec64322ac862] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:43.894 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,52a7aa92fec694b0,0b3d13bf7adff8c6] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=52a7aa92fec694b0, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 14:00:43.895 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,52a7aa92fec694b0,0b3d13bf7adff8c6] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=52a7aa92fec694b0, duration=1 ms] 2025-09-16 14:00:44.814 WARN 9 --- [ocp-async-2,83b86ec688524cc2,6e7f4e1c8501c1d3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:44.814 INFO 9 --- [ocp-async-8,ece71d2f9ab0570e,13bd4a764d08a79e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:44.897 INFO 9 --- [ocp-schedules-27,67789a553b6f2f58,0978169e8992e8a6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:00:45.610 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:45.611 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:46.636 INFO 9 --- [prometheus-minute-schedule-1,f07d7598966c1668,b8eda126d86ed6b3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:46.639 INFO 9 --- [prometheus-minute-schedule-1,f07d7598966c1668,b8eda126d86ed6b3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:46.814 WARN 9 --- [ocp-async-8,01ac2a3118ac3ccf,0aeb62f57253b3ab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:46.814 INFO 9 --- [ocp-async-8,e1a32389c30725ec,368078baa15e1b39] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:46.832 INFO 9 --- [ocp-schedules-7,6467c266b19e428c,066932f2df54da4d] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 14:00:46.833 INFO 9 --- [ocp-schedules-7,6467c266b19e428c,066932f2df54da4d] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:46.879 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:00:46.880 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:46.882 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:00:46.909 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:46.909 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:00:46.932 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:46.932 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:00:46.955 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:46.955 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:00:46.959 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:46.960 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:00:46.983 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:46.983 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:00:47.004 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.004 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:00:47.009 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.011 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:00:47.032 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.033 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:00:47.057 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.057 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:00:47.073 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.074 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 14:00:47.075 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.076 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:00:47.076 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.077 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:00:47.078 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.079 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 14:00:47.079 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.080 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:00:47.081 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.081 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:00:47.099 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.100 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 14:00:47.100 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.101 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:00:47.102 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.103 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:00:47.118 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 14:00:47.120 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 14:00:47.146 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:00:47.147 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:47.148 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 14:00:47.179 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:00:47.179 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 14:00:47.179 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:00:47.179 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 14:00:47.179 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:00:47.179 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 14:00:47.182 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 14:00:47.182 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:00:47.182 INFO 9 --- [ocp-schedules-7,6467c266b19e428c,066932f2df54da4d] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 14:00:48,031 |-INFO in ReconfigureOnChangeTask(born:1758002328031) - Empty watch file list. Disabling 2025-09-16 14:00:48.611 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:48.612 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:48.815 WARN 9 --- [ocp-async-8,5dd53a471284bc52,b35928e7eedf2c16] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:48.815 INFO 9 --- [ocp-async-3,836a182b7ac12be1,31297caa7b83c686] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:49.223 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 14:00:49.238 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 14:00:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 14:00:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 14:00:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 14:00:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 14:00:49.251 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 14:00:49.254 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.254 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.254 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.254 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.254 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.255 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:49.255 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:49.255 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:49.255 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:49.255 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:49.256 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.256 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.256 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.256 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.256 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:49.256 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:49.256 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:49.257 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:49.257 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:49.257 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:00:49.276 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T13:58:30, start=2025-09-16T13:55:00, end=2025-09-16T13:57:30, updates=74, granule=120000ms, delay=210000ms 2025-09-16 14:00:49.278 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T13:58:30, start=2025-09-16T13:55:00, end=2025-09-16T13:57:30, updates=78, granule=120000ms, delay=210000ms 2025-09-16 14:00:49.280 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T13:58:30, start=2025-09-16T13:55:00, end=2025-09-16T13:57:30, updates=99, granule=120000ms, delay=210000ms 2025-09-16 14:00:49.280 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:58:30, target=2025-09-16T13:57:30, granule=120000ms, delay=60000ms) 2025-09-16 14:00:49.280 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:57:30, target=2025-09-16T13:47:30, granule=600000ms, delay=600000ms) 2025-09-16 14:00:49.284 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:58:30, target=2025-09-16T13:57:30, granule=120000ms, delay=60000ms) 2025-09-16 14:00:49.284 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:57:30, target=2025-09-16T13:47:30, granule=600000ms, delay=600000ms) 2025-09-16 14:00:49.284 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T13:58:30, start=2025-09-16T13:55:00, end=2025-09-16T13:57:30, updates=160, granule=120000ms, delay=210000ms 2025-09-16 14:00:49.286 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:58:30, target=2025-09-16T13:57:30, granule=120000ms, delay=60000ms) 2025-09-16 14:00:49.286 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:57:30, target=2025-09-16T13:47:30, granule=600000ms, delay=600000ms) 2025-09-16 14:00:49.287 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T13:58:30, start=2025-09-16T13:55:00, end=2025-09-16T13:57:30, updates=189, granule=120000ms, delay=210000ms 2025-09-16 14:00:49.288 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:58:30, target=2025-09-16T13:57:30, granule=120000ms, delay=60000ms) 2025-09-16 14:00:49.288 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:57:30, target=2025-09-16T13:47:30, granule=600000ms, delay=600000ms) 2025-09-16 14:00:49.292 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T13:58:30, target=2025-09-16T13:57:30, granule=120000ms, delay=60000ms) 2025-09-16 14:00:49.292 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T13:57:30, target=2025-09-16T13:47:30, granule=600000ms, delay=600000ms) 2025-09-16 14:00:49.292 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=69ms, period=120000ms 2025-09-16 14:00:49.315 INFO 9 --- [ocp-schedules-5,5871a7450432a0ec,579c8c692b3b6f32] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:00:49.317 INFO 9 --- [ocp-schedules-5,5871a7450432a0ec,579c8c692b3b6f32] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:00:49.636 INFO 9 --- [prometheus-minute-schedule-1,f0e33e9ceacd04b0,6fef47403ca098c7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:49.639 INFO 9 --- [prometheus-minute-schedule-1,f0e33e9ceacd04b0,6fef47403ca098c7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:00:50.004001+08:00, lastProcessTime=2025-09-16T14:00:40.002928+08:00 2025-09-16 14:00:50.112 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:00:50.004001+08:00 2025-09-16 14:00:50.188 INFO 9 --- [ocp-async-6,a1e802e7e4ba3125,5d60d8f3703af537] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:00:50.815 WARN 9 --- [ocp-async-2,5ea3049cd376ebed,82b2463342319e8c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:50.815 INFO 9 --- [ocp-async-7,16e2e94076e2c1fb,ded3b2ca88aeb6d6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:51.612 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:51.612 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:52.274 INFO 9 --- [ocp-schedules-27,6e79d8acfd215fc6,c9023228454474c4] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:00:52.279 WARN 9 --- [scanner-1387388-1,6e79d8acfd215fc6,c74c5eb47c4888ef] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:00:52.636 INFO 9 --- [prometheus-minute-schedule-1,94761ae0efeaba80,2a9c68e1b94770d5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:52.639 INFO 9 --- [prometheus-minute-schedule-1,94761ae0efeaba80,2a9c68e1b94770d5] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:52.815 WARN 9 --- [ocp-async-1,8093aed13bcb122f,693ce10cf2182a70] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:52.815 INFO 9 --- [ocp-async-5,9e82d8943f89884a,674929161201bf6c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:54.612 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:54.613 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:54.780 INFO 9 --- [ocp-schedules-28,03765a27cc22b24b,25d6140f0fff02b0] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:00:54.785 INFO 9 --- [ocp-schedules-28,03765a27cc22b24b,25d6140f0fff02b0] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:00:54.785 INFO 9 --- [ocp-schedules-28,03765a27cc22b24b,25d6140f0fff02b0] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:00:54.815 WARN 9 --- [ocp-async-5,452236ddab69cd15,71eea14d1004e490] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:54.815 INFO 9 --- [ocp-async-10,8136d912138269e8,d83c5ebe9e2cbb21] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:54.900 INFO 9 --- [ocp-schedules-3,00f1c7819d75c290,874fa25006d67edc] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:00:55.636 INFO 9 --- [prometheus-minute-schedule-1,f6c5e5db67b2ad30,86f26196a263cafa] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:55.640 INFO 9 --- [prometheus-minute-schedule-1,f6c5e5db67b2ad30,86f26196a263cafa] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:56.815 WARN 9 --- [ocp-async-10,1b5129d25ea4fbaf,bc95929331f23d4e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:56.815 INFO 9 --- [ocp-async-2,0b414467987b59e3,854cb4c31b82a9bb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:57.613 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:00:57.613 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:00:58.636 INFO 9 --- [prometheus-minute-schedule-1,f32563beaf253d4a,6e66b0ec1eee8a97] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002460, interval=60 2025-09-16 14:00:58.639 INFO 9 --- [prometheus-minute-schedule-1,f32563beaf253d4a,6e66b0ec1eee8a97] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:00:58.815 WARN 9 --- [ocp-async-6,c0b7ab0b495e935e,154ffb9ecfded168] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:00:58.815 INFO 9 --- [ocp-async-1,63688c9807e8bbb5,d7f2705c2471538e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:00:59.321 INFO 9 --- [ocp-schedules-16,811f80d74af3db59,82e7ffac09e7e543] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:00:59.323 INFO 9 --- [ocp-schedules-16,811f80d74af3db59,82e7ffac09e7e543] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:00:59.938 INFO 9 --- [ocp-schedules-28,7e480e214840fb5d,3e8761ea3397dfbd] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:00:59.941 INFO 9 --- [ocp-schedules-30,2e0b3472d41c0660,8514c47ff165cfae] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:00:59.941 INFO 9 --- [ocp-schedules-23,fecf50103c385f8d,b81d4826250ef84e] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:00:59.942 INFO 9 --- [ocp-schedules-24,ba266bab9fbf418b,4ea3b7ad569eadf1] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:00:59.943 INFO 9 --- [ocp-schedules-23,fecf50103c385f8d,b81d4826250ef84e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:59.943 INFO 9 --- [ocp-schedules-30,2e0b3472d41c0660,8514c47ff165cfae] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:59.943 INFO 9 --- [ocp-schedules-24,ba266bab9fbf418b,4ea3b7ad569eadf1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:00:59.944 INFO 9 --- [ocp-schedules-24,ba266bab9fbf418b,4ea3b7ad569eadf1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:00:59.944 INFO 9 --- [ocp-schedules-9,702194970d6d89ac,adc6a76b7bf06ca0] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:59.944 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:00:59.944 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:00:59.945 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:00:59.945 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:00:59.945 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:00:59.945 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:00:59.945 INFO 9 --- [ocp-schedules-13,e9b001d95f99decb,07e2f0f9f2c9cb4d] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:59.946 INFO 9 --- [host-check-agent-status1,e9b001d95f99decb,e347cbd640e76b6a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:00:59.946 INFO 9 --- [host-check-agent-status2,e9b001d95f99decb,f24c287e662cffe0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:00:59.946 INFO 9 --- [host-check-agent-status3,e9b001d95f99decb,babc76dc0bbb0f52] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:00:59.946 INFO 9 --- [host-check-agent-status4,e9b001d95f99decb,6446b088a7e04503] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:00:59.946 INFO 9 --- [host-check-agent-status5,e9b001d95f99decb,fcc5b63175d2e803] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:00:59.946 INFO 9 --- [host-check-agent-status6,e9b001d95f99decb,9b3d3c3fcaac95b6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:00:59.946 INFO 9 --- [ocp-schedules-20,0e4e4b63b439c423,823d3e04bcfc1a7a] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:00:59.946 INFO 9 --- [host-check-clockdiff1,0e4e4b63b439c423,837b92435f89237e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:00:59.946 INFO 9 --- [host-check-clockdiff2,0e4e4b63b439c423,fcbee520c16db091] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:00:59.946 INFO 9 --- [host-check-clockdiff3,0e4e4b63b439c423,645fdc132c1e9d25] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:00:59.946 INFO 9 --- [host-check-clockdiff4,0e4e4b63b439c423,1cbbb7bf2b8d6604] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:00:59.946 INFO 9 --- [host-check-clockdiff5,0e4e4b63b439c423,86efc5ebdac6b762] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:00:59.946 INFO 9 --- [host-check-clockdiff6,0e4e4b63b439c423,5b0bc9a7c26c1b13] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:00:59.947 INFO 9 --- [ocp-schedules-2,c82c6977f49dc8b0,bbbd237f3d3fd6d2] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:00:59.948 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:59.950 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:59.950 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:59.954 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:59.954 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:59.954 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:59.954 INFO 9 --- [host-check-clockdiff5,0e4e4b63b439c423,86efc5ebdac6b762] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002459 -1 -1 , error= 2025-09-16 14:00:59.954 INFO 9 --- [host-check-clockdiff3,0e4e4b63b439c423,645fdc132c1e9d25] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002459 -2 -2 , error= 2025-09-16 14:00:59.954 INFO 9 --- [host-check-clockdiff4,0e4e4b63b439c423,1cbbb7bf2b8d6604] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002459 -1 -1 , error= 2025-09-16 14:00:59.954 INFO 9 --- [host-check-clockdiff2,0e4e4b63b439c423,fcbee520c16db091] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002459 -2 -2 , error= 2025-09-16 14:00:59.954 INFO 9 --- [host-check-clockdiff1,0e4e4b63b439c423,837b92435f89237e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002459 -1 -1 , error= 2025-09-16 14:00:59.954 INFO 9 --- [host-check-clockdiff6,0e4e4b63b439c423,5b0bc9a7c26c1b13] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002459 -1 -1 , error= 2025-09-16 14:00:59.955 INFO 9 --- [host-check-agent-status3,e9b001d95f99decb,babc76dc0bbb0f52] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:59.955 INFO 9 --- [host-check-agent-status5,e9b001d95f99decb,fcc5b63175d2e803] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:59.955 INFO 9 --- [host-check-agent-status2,e9b001d95f99decb,f24c287e662cffe0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:59.955 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:59.956 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:59.956 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:59.956 INFO 9 --- [host-check-agent-status1,e9b001d95f99decb,e347cbd640e76b6a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:59.956 INFO 9 --- [host-check-agent-status6,e9b001d95f99decb,9b3d3c3fcaac95b6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:59.957 INFO 9 --- [host-check-agent-status4,e9b001d95f99decb,6446b088a7e04503] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:59.957 INFO 9 --- [host-check-agent-status2,e9b001d95f99decb,f24c287e662cffe0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:59.957 INFO 9 --- [host-check-agent-status5,e9b001d95f99decb,fcc5b63175d2e803] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:59.957 INFO 9 --- [host-check-agent-status3,e9b001d95f99decb,babc76dc0bbb0f52] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:59.957 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:59.957 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:59.958 INFO 9 --- [host-check-agent-status6,e9b001d95f99decb,9b3d3c3fcaac95b6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:59.958 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:59.958 INFO 9 --- [host-check-agent-status4,e9b001d95f99decb,6446b088a7e04503] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:59.958 INFO 9 --- [host-check-agent-status1,e9b001d95f99decb,e347cbd640e76b6a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:59.970 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:00:59.970 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:00:59.971 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-agent-status2,e9b001d95f99decb,f24c287e662cffe0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:00:59.970907847+08:00 2025-09-16 14:00:59.972 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:00:59.970568304+08:00 2025-09-16 14:00:59.972 INFO 9 --- [host-check-agent-status3,e9b001d95f99decb,babc76dc0bbb0f52] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-agent-status1,e9b001d95f99decb,e347cbd640e76b6a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:00:59.972+08:00 2025-09-16 14:00:59.972 INFO 9 --- [host-check-agent-status5,e9b001d95f99decb,fcc5b63175d2e803] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:00:59.972+08:00 2025-09-16 14:00:59.972 INFO 9 --- [host-check-agent-status6,e9b001d95f99decb,9b3d3c3fcaac95b6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:00:59.972 INFO 9 --- [host-check-agent-status4,e9b001d95f99decb,6446b088a7e04503] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:00:59.973 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:00:59.971411291+08:00 2025-09-16 14:00:59.973 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:00:59.973 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:00:59.973+08:00 2025-09-16 14:00:59.973 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:00:59.972631491+08:00 2025-09-16 14:00:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:59.974 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:00:59.972983342+08:00 2025-09-16 14:00:59.974 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:00:59.972+08:00 and status AVAILABLE 2025-09-16 14:00:59.974 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:00:59.973+08:00 2025-09-16 14:00:59.974 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:00:59.972+08:00 and status AVAILABLE 2025-09-16 14:00:59.974 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:00:59.974+08:00 2025-09-16 14:00:59.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:00:59.975 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:00:59.973+08:00 and status AVAILABLE 2025-09-16 14:00:59.975 INFO 9 --- [host-check-agent-status2,e9b001d95f99decb,f24c287e662cffe0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:00:59.975 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:00:59.973478891+08:00 2025-09-16 14:00:59.975 INFO 9 --- [host-check-agent-status2,e9b001d95f99decb,f24c287e662cffe0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:00:59.975 INFO 9 --- [host-check-agent-status2,e9b001d95f99decb,f24c287e662cffe0] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:00:59.975 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:00:59.975+08:00 2025-09-16 14:00:59.975 INFO 9 --- [host-check-agent-status1,e9b001d95f99decb,e347cbd640e76b6a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:00:59.975 INFO 9 --- [host-check-agent-status1,e9b001d95f99decb,e347cbd640e76b6a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:00:59.975 INFO 9 --- [host-check-agent-status1,e9b001d95f99decb,e347cbd640e76b6a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:00:59.976 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:00:59.973+08:00 and status AVAILABLE 2025-09-16 14:00:59.976 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:00:59.974+08:00 and status AVAILABLE 2025-09-16 14:00:59.976 INFO 9 --- [host-check-agent-status3,e9b001d95f99decb,babc76dc0bbb0f52] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:00:59.976 INFO 9 --- [host-check-agent-status3,e9b001d95f99decb,babc76dc0bbb0f52] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:00:59.976 INFO 9 --- [host-check-agent-status3,e9b001d95f99decb,babc76dc0bbb0f52] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:00:59.976 INFO 9 --- [host-check-agent-status5,e9b001d95f99decb,fcc5b63175d2e803] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:00:59.976 INFO 9 --- [host-check-agent-status5,e9b001d95f99decb,fcc5b63175d2e803] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:00:59.976 INFO 9 --- [host-check-agent-status5,e9b001d95f99decb,fcc5b63175d2e803] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:00:59.976 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:00:59.975+08:00 and status AVAILABLE 2025-09-16 14:00:59.977 INFO 9 --- [host-check-agent-status4,e9b001d95f99decb,6446b088a7e04503] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:00:59.977 INFO 9 --- [host-check-agent-status4,e9b001d95f99decb,6446b088a7e04503] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:00:59.977 INFO 9 --- [host-check-agent-status4,e9b001d95f99decb,6446b088a7e04503] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:00:59.977 INFO 9 --- [host-check-agent-status6,e9b001d95f99decb,9b3d3c3fcaac95b6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:00:59.977 INFO 9 --- [host-check-agent-status6,e9b001d95f99decb,9b3d3c3fcaac95b6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:00:59.977 INFO 9 --- [host-check-agent-status6,e9b001d95f99decb,9b3d3c3fcaac95b6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:00:59.977 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:00:59.979 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:00:59.979 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:00:59.979 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:00:59.979 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:00:59.979 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:00:59.980 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:00:59.980 INFO 9 --- [ocp-schedules-23,fecf50103c385f8d,b81d4826250ef84e] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:00:59.983 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:00:59.984 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:00:59.984 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:00:59.984 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:00:59.985 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:00:59.985 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:00:59.985 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:00:59.985 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:00:59.985 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:00:59.985 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:00:59.986 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:00:59.987 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:00:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:00:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:00:59.997 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:00:59.999 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:00.000 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:00.000 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:00.000 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:00.000 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:00.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:01:00.002716+08:00, lastProcessTime=2025-09-16T14:00:50.004001+08:00 2025-09-16 14:01:00.027 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:01:00.027 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:00.027 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:01:00.027 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:01:00.027 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:01:00.028 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:00.029 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:01:00.030 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:01:00.034 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:01:00.034 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:01:00.034 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:01:00.034 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:01:00.035 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:01:00.037 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:01:00.041 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:01:00.046 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:00.046 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:00.047 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:00.047 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:00.048 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:00.053 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:00.064 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:00.065 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:00.066 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:01:00.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:01:00.073 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:00.074 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:01:00.074 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:01:00.075 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:01:00.076 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:01:00.079 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:01:00.080 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:01:00.080 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:01:00.081 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:01:00.081 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:01:00.082 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:01:00.086 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:01:00.087 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:01:00.088 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.088 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:00.092 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:00.093 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:00.093 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:00.095 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:00.096 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:00.098 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:00.104 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.104 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:00.118 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.118 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:00.120 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:01:00.121 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:01:00.124 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:01:00.127 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:01:00.127 INFO 9 --- [host-check-host-status1,702194970d6d89ac,d86c1bc56d2dc15f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:01:00.127 INFO 9 --- [host-check-host-status5,702194970d6d89ac,968c236ae7b61fd6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:01:00.128 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:01:00.129 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:01:00.130 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:01:00.002716+08:00 2025-09-16 14:01:00.131 INFO 9 --- [host-check-host-status3,702194970d6d89ac,40a40f6aa18300eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:01:00.133 INFO 9 --- [host-check-host-status4,702194970d6d89ac,699b24b28257b1c7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:01:00.134 INFO 9 --- [host-check-host-status6,702194970d6d89ac,02beeaaacea95844] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:01:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:00.136 INFO 9 --- [host-check-host-status2,702194970d6d89ac,bb700d1280abdf58] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:01:00.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:00.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:00.188 INFO 9 --- [ocp-async-10,8c74b1489a307917,5151d70c57d92888] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:01:00.195 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.195 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:00.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:00.224 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:00.238 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:00.240 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:00.240 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:01:00.246 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:01:00.249 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:01:00.252 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:00.253 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:00.267 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:01:00.315 INFO 9 --- [task-coordinator3,25e389618b93fdc9,96244e8232efc1df] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 13:01:00.0, nextRun=2025-09-16 14:01:00.0, currentDate=Tue Sep 16 14:01:00 CST 2025 2025-09-16 14:01:00.315 INFO 9 --- [task-coordinator3,25e389618b93fdc9,96244e8232efc1df] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999995, name=Collect cluster snapshot, templateName=CollectClusterSnapshotSchedule, scheduleRule=0 1 * * * *, lastRunTime=2025-09-16 13:01:00.0, nextRunTime=2025-09-16 14:01:00.0} 2025-09-16 14:01:00.316 WARN 9 --- [task-coordinator3,25e389618b93fdc9,96244e8232efc1df] o.p.s.d.i.CollectClusterSnapshotSchedule : Snapshot service is disabled. Please check config: ocp.perf.snapshot.generation.enable 2025-09-16 14:01:00.316 WARN 9 --- [task-coordinator3,25e389618b93fdc9,96244e8232efc1df] o.p.s.d.i.CollectClusterSnapshotSchedule : Snapshot service is disabled. Please check config: ocp.perf.snapshot.generation.enable 2025-09-16 14:01:00.316 WARN 9 --- [task-coordinator3,25e389618b93fdc9,96244e8232efc1df] c.o.o.c.t.e.c.worker.ReadyTaskWorker : failed to get template for class, action=com.oceanbase.ocp.perf.sql.diag.internal.CollectClusterSnapshotSchedule java.lang.NullPointerException: null at com.oceanbase.ocp.perf.sql.diag.internal.CollectClusterSnapshotSchedule.ready(CollectClusterSnapshotSchedule.java:74) at com.oceanbase.ocp.core.task.engine.coordinator.worker.ReadyTaskWorker.getTaskMeta(ReadyTaskWorker.java:373) at com.oceanbase.ocp.core.task.engine.coordinator.worker.ReadyTaskWorker.checkAndScheduleCronTask(ReadyTaskWorker.java:178) at com.oceanbase.ocp.core.task.engine.coordinator.worker.ReadyTaskWorker.lambda$loopScheduleTask$1(ReadyTaskWorker.java:139) at org.springframework.transaction.support.TransactionOperations.lambda$executeWithoutResult$0(TransactionOperations.java:68) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.task.engine.coordinator.worker.AbstractTaskWorker.transactionWithoutResult(AbstractTaskWorker.java:61) at com.oceanbase.ocp.core.task.engine.coordinator.worker.ReadyTaskWorker.loopScheduleTask(ReadyTaskWorker.java:138) at com.oceanbase.ocp.core.task.engine.coordinator.worker.ReadyTaskWorker.work(ReadyTaskWorker.java:107) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:136) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:74) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:01:00.319 INFO 9 --- [task-coordinator3,25e389618b93fdc9,96244e8232efc1df] c.o.o.c.t.e.c.worker.SubtaskGenerator : Split list is empty, name=Collect cluster hour metric, splitKey=cluster_ids, context=Argument{parallelIdx=-1, stringMap={}, listMap={}} 2025-09-16 14:01:00.320 WARN 9 --- [task-coordinator3,25e389618b93fdc9,96244e8232efc1df] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Subtask is empty, mark task failed, name=Collect cluster hour metric, taskId=826 2025-09-16 14:01:00.329 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:01:00.343 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:00.344 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:00.345 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:01:00.359 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:01:00.359 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:01:00.359 INFO 9 --- [ocp-schedules-30,2e0b3472d41c0660,8514c47ff165cfae] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:01:00.614 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:00.614 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:00.815 WARN 9 --- [ocp-async-5,4046d09dc6c2873d,b86dc1894cfd853b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:00.815 INFO 9 --- [ocp-async-4,507f2bd245b4f235,6663f812a8722602] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:00.872 INFO 9 --- [ocp-schedules-20,b8db99d38662bc9d,0ca4d57feb454e65] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:01:01.636 INFO 9 --- [prometheus-minute-schedule-1,4e82fe8f9df2efdf,36a0fa024b6e64a9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:01.639 INFO 9 --- [prometheus-minute-schedule-1,4e82fe8f9df2efdf,36a0fa024b6e64a9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:02.300 INFO 9 --- [ocp-schedules-22,7093527da440bd1b,9c8fbbe1b30d3391] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:01:02.306 WARN 9 --- [scanner-1387518-1,7093527da440bd1b,59a5db730b1fa652] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:01:02.316 INFO 9 --- [alarm-detect-18,7093527da440bd1b,12117711d9b8aa7a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:01:02.318 INFO 9 --- [alarm-detect-6,7093527da440bd1b,61b65d32382042fb] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:01:02.318 INFO 9 --- [alarm-detect-4,7093527da440bd1b,4d61bb0f0d30ad1e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:01:02.332 INFO 9 --- [alarm-detect-16,7093527da440bd1b,27d6a9d2d5496cc0] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:01:02.815 WARN 9 --- [ocp-async-10,0f67934a9d5d6f0b,e17892d4fc32c018] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:02.815 INFO 9 --- [ocp-async-9,9cf8fc9d386fbda4,1c3d8c6805cd0ea6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:03.614 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:03.615 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:04.636 INFO 9 --- [prometheus-minute-schedule-1,5277f8f406486532,f83f5eb37b4acb8a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:04.639 INFO 9 --- [prometheus-minute-schedule-1,5277f8f406486532,f83f5eb37b4acb8a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:04.815 INFO 9 --- [ocp-async-6,f15e4d446c352c54,4547ae432f6f0528] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:04.815 WARN 9 --- [ocp-async-7,dce197e381d2f019,872eba50d3a16b08] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:04.904 INFO 9 --- [ocp-schedules-1,accf5b3a0212c455,9361d7448d590a8c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:01:06.615 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:06.615 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:06.816 INFO 9 --- [ocp-async-8,469af3dab23fe458,21729f4cc2b93a26] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:06.816 WARN 9 --- [ocp-async-5,864d434ccf8bc3fa,4e02e0a3e9bb3fd0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:07.636 INFO 9 --- [prometheus-minute-schedule-1,c9b60ad6e893cb92,0cd27d13a821d3c2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:07.639 INFO 9 --- [prometheus-minute-schedule-1,c9b60ad6e893cb92,0cd27d13a821d3c2] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:08.816 INFO 9 --- [ocp-async-4,e343539f02b0baf1,1f42efff8e53ae97] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:08.816 WARN 9 --- [ocp-async-10,312fe649a22907ab,1ec6e37c6c0fc772] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:09.329 INFO 9 --- [ocp-schedules-1,3720d33dfa9bac21,ced968d373d52e5c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:01:09.331 INFO 9 --- [ocp-schedules-1,3720d33dfa9bac21,ced968d373d52e5c] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:01:09.615 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:09.616 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:10.002 INFO 9 --- [ocp-schedules-25,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 14:01:10.002 INFO 9 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 14:01:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:01:10.003759+08:00, lastProcessTime=2025-09-16T14:01:00.002716+08:00 2025-09-16 14:01:10.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:01:10.003759+08:00 2025-09-16 14:01:10.188 INFO 9 --- [ocp-async-5,713984f8a95c6e8e,77487be6836c9ce8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:01:10.295 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 14:01:10.636 INFO 9 --- [prometheus-minute-schedule-1,b8f726c1a661c2e8,61c73c20e98b6d5e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:10.640 INFO 9 --- [prometheus-minute-schedule-1,b8f726c1a661c2e8,61c73c20e98b6d5e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:10.816 INFO 9 --- [ocp-async-7,edda34b40de56460,07d523352fc914b8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:10.816 WARN 9 --- [ocp-async-1,678e371cafd0f2e0,efcf77bf8c5b5655] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:11.764 INFO 9 --- [metric-archive-async-2,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002400, nodeCount=463, affectRows=463 2025-09-16 14:01:12.334 INFO 9 --- [ocp-schedules-30,a02b3fa0e82949f2,6f1116a6c0ac06d0] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:01:12.339 WARN 9 --- [scanner-1388557-1,a02b3fa0e82949f2,f874af4dfa52af54] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:01:12.616 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:12.617 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:12.816 WARN 9 --- [ocp-async-3,2c27af748f11c629,4dac1962d8a9c4be] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:12.816 INFO 9 --- [ocp-async-5,f9080d4df24db87a,1952e3bc99398dae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:12.996 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002400, nodeCount=1000, affectRows=1000 2025-09-16 14:01:12.998 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002400, nodeCount=1000, validCount=996 2025-09-16 14:01:13.023 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002400, nodeCount=1000, affectRows=1000 2025-09-16 14:01:13.026 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002400, nodeCount=1000, validCount=998 2025-09-16 14:01:13.037 ERROR 9 --- [metric-archive-second-2,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824147022748467200-1758002340' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824147022748467200-1758002340' for key 'PRIMARY' 2025-09-16 14:01:13.636 INFO 9 --- [prometheus-minute-schedule-1,20d8e78eee0b3cff,5457d2b5994d0e20] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:13.639 INFO 9 --- [prometheus-minute-schedule-1,20d8e78eee0b3cff,5457d2b5994d0e20] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:14.365 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002400, nodeCount=1000, affectRows=1000 2025-09-16 14:01:14.368 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002400, nodeCount=992, validCount=946 2025-09-16 14:01:14.391 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002400, nodeCount=853, affectRows=853 2025-09-16 14:01:14.393 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002400, nodeCount=852, validCount=850 2025-09-16 14:01:14.787 INFO 9 --- [ocp-schedules-1,5963be6a7257e98a,1dfe2f17af158dca] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:01:14.792 INFO 9 --- [ocp-schedules-1,5963be6a7257e98a,1dfe2f17af158dca] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:01:14.792 INFO 9 --- [ocp-schedules-1,5963be6a7257e98a,1dfe2f17af158dca] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:01:14.816 WARN 9 --- [ocp-async-2,bd9c37474b5d6e45,0cd8c6ffc2e36b74] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:14.816 INFO 9 --- [ocp-async-10,ae14d45c42a2aa35,88c6e90d2deb4528] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:14.907 INFO 9 --- [ocp-schedules-30,5fcc9f59d48c0c1d,6d92036463568827] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:01:15.617 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:15.617 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:16.636 INFO 9 --- [prometheus-minute-schedule-1,f22d8ff1c779f11f,2f638cdc7077c2df] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:16.639 INFO 9 --- [prometheus-minute-schedule-1,f22d8ff1c779f11f,2f638cdc7077c2df] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:16.816 WARN 9 --- [ocp-async-9,4cdc3ab3e4bcb3f4,7fae70d0aa391853] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:16.816 INFO 9 --- [ocp-async-1,3205a970a855b409,cc9ad9e5810eca29] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:18.617 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:18.618 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:18.816 INFO 9 --- [ocp-async-7,9ad0c5c2c94efe81,43ab38f2f46b6c9b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:18.816 WARN 9 --- [ocp-async-3,5a8dad6f36914d9f,b18b7ba3f69c727d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:19.336 INFO 9 --- [ocp-schedules-23,90881beff97c378d,95701ab0d766ea6b] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:01:19.338 INFO 9 --- [ocp-schedules-23,90881beff97c378d,95701ab0d766ea6b] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:01:19.636 INFO 9 --- [prometheus-minute-schedule-1,7f66a5556a459846,a95235101d911f51] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:19.639 INFO 9 --- [prometheus-minute-schedule-1,7f66a5556a459846,a95235101d911f51] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:01:20.003080+08:00, lastProcessTime=2025-09-16T14:01:10.003759+08:00 2025-09-16 14:01:20.116 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:01:20.003080+08:00 2025-09-16 14:01:20.189 INFO 9 --- [ocp-async-9,56c65e7eaa3ff31f,9e33f163975065f5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:01:20.636 INFO 9 --- [prometheus-cache-monitor1,e67e10649c40bddc,78b77d902bdcef7a] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3809,"seriesIdKeySize":16769,"secondWriteQueue":0,"minuteWriteCacheSize":14398} 2025-09-16 14:01:20.636 INFO 9 --- [prometheus-cache-monitor1,e67e10649c40bddc,78b77d902bdcef7a] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:01:20.816 INFO 9 --- [ocp-async-2,af6825d3b8afbf19,f9f717b935202c5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:20.816 WARN 9 --- [ocp-async-4,3bfb309f8f33fd2d,5257ff101b13104a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:21.618 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:21.619 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:22.378 INFO 9 --- [ocp-schedules-4,d68eadc0f8a6f255,dfe19128750f39b6] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:01:22.382 WARN 9 --- [scanner-1388680-1,d68eadc0f8a6f255,a0410788141d1c21] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:01:22.392 INFO 9 --- [alarm-detect-16,d68eadc0f8a6f255,29773046335c110c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:01:22.394 INFO 9 --- [alarm-detect-13,d68eadc0f8a6f255,8da85ff8c0ca680e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:01:22.394 INFO 9 --- [alarm-detect-2,d68eadc0f8a6f255,60251a9f17e19377] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:01:22.406 INFO 9 --- [alarm-detect-13,d68eadc0f8a6f255,0ed2ba1302c5089f] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:01:22.636 INFO 9 --- [prometheus-minute-schedule-1,8d17e38cda055fff,8550ccff524d5cf4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:22.639 INFO 9 --- [prometheus-minute-schedule-1,8d17e38cda055fff,8550ccff524d5cf4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:22.817 INFO 9 --- [ocp-async-9,ccbbf91f51cd3a62,fef217f8e1cb94bd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:22.817 WARN 9 --- [ocp-async-6,c4b006e0aa304441,133df4461cf66323] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:24.619 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:24.619 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:24.817 INFO 9 --- [ocp-async-3,1fa8a92dc8d07deb,baa1b416a358aa78] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:24.817 WARN 9 --- [ocp-async-8,9bcd9776ebac3a38,a6ce703b4ee13f1b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:24.910 INFO 9 --- [ocp-schedules-15,047027d56c4391a5,a8a95cd37d747ec0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:01:25.636 INFO 9 --- [prometheus-minute-schedule-1,80b21d215c972dbf,a46bc9dffa7ea423] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:25.639 INFO 9 --- [prometheus-minute-schedule-1,80b21d215c972dbf,a46bc9dffa7ea423] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:26.817 INFO 9 --- [ocp-async-5,83c3333c4ca284ba,4f213789bc8e051a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:26.817 WARN 9 --- [ocp-async-4,05788d276e5dc12f,75076cf981344481] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:27.619 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:27.620 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:28.636 INFO 9 --- [prometheus-minute-schedule-1,4d76fa34f0acc574,89f2753b614049e0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:28.639 INFO 9 --- [prometheus-minute-schedule-1,4d76fa34f0acc574,89f2753b614049e0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:28.817 INFO 9 --- [ocp-async-2,0bf29aefbefda1ce,fd2ce5698aba5b53] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:28.817 WARN 9 --- [ocp-async-6,68c8112d7937ebdb,69514214a5fd3cb3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:29.343 INFO 9 --- [ocp-schedules-29,f5aa5db29dc4abb6,0522f5696687c178] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:01:29.344 INFO 9 --- [ocp-schedules-29,f5aa5db29dc4abb6,0522f5696687c178] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:01:29.938 INFO 9 --- [ocp-schedules-11,c8cbd35a699bc65c,54f0966a43c5afa1] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:01:29.941 INFO 9 --- [ocp-schedules-11,f9795e1682b47f08,f02603fe2315560f] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:01:29.941 INFO 9 --- [ocp-schedules-28,bcd969378614e6f7,c2874468154a23b7] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:01:29.942 INFO 9 --- [ocp-schedules-3,7ca2defc092690e7,4dbc57957eb231ee] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:01:29.942 INFO 9 --- [ocp-schedules-11,f9795e1682b47f08,f02603fe2315560f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:29.943 INFO 9 --- [ocp-schedules-3,7ca2defc092690e7,4dbc57957eb231ee] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:29.943 INFO 9 --- [ocp-schedules-28,bcd969378614e6f7,c2874468154a23b7] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:29.944 INFO 9 --- [ocp-schedules-3,7ca2defc092690e7,4dbc57957eb231ee] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:01:29.944 INFO 9 --- [ocp-schedules-26,008204a63643144f,69e771173395ac36] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:01:29.945 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:01:29.945 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:01:29.945 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:01:29.945 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:01:29.945 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:01:29.945 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:01:29.946 INFO 9 --- [ocp-schedules-5,be76a86a750e0f65,1a18726fcea6d5b3] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:01:29.946 INFO 9 --- [host-check-agent-status1,be76a86a750e0f65,632d8ccae0c88e70] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:01:29.946 INFO 9 --- [host-check-agent-status2,be76a86a750e0f65,dc6875a6b91a9623] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:01:29.946 INFO 9 --- [host-check-agent-status3,be76a86a750e0f65,825d0df579b37190] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:01:29.946 INFO 9 --- [host-check-agent-status4,be76a86a750e0f65,9e08d1e731128d63] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:01:29.946 INFO 9 --- [ocp-schedules-17,11da63aa3afab7b8,6e147760c8e2f95e] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:01:29.946 INFO 9 --- [host-check-agent-status5,be76a86a750e0f65,312b350d77593bdb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:01:29.946 INFO 9 --- [host-check-agent-status6,be76a86a750e0f65,d57ade34c2359530] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:01:29.946 INFO 9 --- [host-check-clockdiff1,11da63aa3afab7b8,d8137bc1831449fb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:01:29.946 INFO 9 --- [host-check-clockdiff2,11da63aa3afab7b8,c79f33d59f9ff3cb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:01:29.946 INFO 9 --- [host-check-clockdiff3,11da63aa3afab7b8,eab57607983fa73a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:01:29.946 INFO 9 --- [host-check-clockdiff4,11da63aa3afab7b8,0587ae0417a14f84] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:01:29.946 INFO 9 --- [host-check-clockdiff5,11da63aa3afab7b8,c48f5ef6451e1e19] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:01:29.946 INFO 9 --- [host-check-clockdiff6,11da63aa3afab7b8,e3ae969acd06f249] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:01:29.947 INFO 9 --- [ocp-schedules-21,aa2399007ab4cc59,fec07ba9c971139d] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:01:29.952 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:01:29.952 INFO 9 --- [host-check-clockdiff3,11da63aa3afab7b8,eab57607983fa73a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002489 -2 -2 , error= 2025-09-16 14:01:29.952 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:01:29.952 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:29.956 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:01:29.956 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:01:29.956 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:01:29.956 INFO 9 --- [host-check-clockdiff2,11da63aa3afab7b8,c79f33d59f9ff3cb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002489 -2 -2 , error= 2025-09-16 14:01:29.958 INFO 9 --- [host-check-clockdiff4,11da63aa3afab7b8,0587ae0417a14f84] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002489 -1 -1 , error= 2025-09-16 14:01:29.958 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:01:29.958 INFO 9 --- [host-check-clockdiff1,11da63aa3afab7b8,d8137bc1831449fb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002489 -1 -1 , error= 2025-09-16 14:01:29.958 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:01:29.958 INFO 9 --- [host-check-agent-status4,be76a86a750e0f65,9e08d1e731128d63] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:01:29.958 INFO 9 --- [host-check-agent-status1,be76a86a750e0f65,632d8ccae0c88e70] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:01:29.958 INFO 9 --- [host-check-agent-status6,be76a86a750e0f65,d57ade34c2359530] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:29.958 INFO 9 --- [host-check-agent-status2,be76a86a750e0f65,dc6875a6b91a9623] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:01:29.958 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:29.958 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:01:29.958 INFO 9 --- [host-check-clockdiff5,11da63aa3afab7b8,c48f5ef6451e1e19] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002489 -1 -1 , error= 2025-09-16 14:01:29.958 INFO 9 --- [host-check-clockdiff6,11da63aa3afab7b8,e3ae969acd06f249] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002489 -1 -1 , error= 2025-09-16 14:01:29.959 INFO 9 --- [host-check-agent-status3,be76a86a750e0f65,825d0df579b37190] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:01:29.959 INFO 9 --- [host-check-agent-status5,be76a86a750e0f65,312b350d77593bdb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:01:29.959 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:01:29.959 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:01:29.960 INFO 9 --- [host-check-agent-status6,be76a86a750e0f65,d57ade34c2359530] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:29.960 INFO 9 --- [host-check-agent-status1,be76a86a750e0f65,632d8ccae0c88e70] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:01:29.960 INFO 9 --- [host-check-agent-status4,be76a86a750e0f65,9e08d1e731128d63] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:01:29.960 INFO 9 --- [host-check-agent-status2,be76a86a750e0f65,dc6875a6b91a9623] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:01:29.960 INFO 9 --- [host-check-agent-status5,be76a86a750e0f65,312b350d77593bdb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:01:29.960 INFO 9 --- [host-check-agent-status3,be76a86a750e0f65,825d0df579b37190] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:01:29.962 INFO 9 --- [ocp-schedules-4,e83b5362b9538241,804dad1be7111797] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 14:01:29.963 INFO 9 --- [ocp-schedules-12,60a6270faaa9783c,61e4398b372905f7] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 14:01:29.968 INFO 9 --- [ocp-schedules-4,e83b5362b9538241,804dad1be7111797] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 14:01:29.969 INFO 9 --- [ocp-schedules-12,60a6270faaa9783c,61e4398b372905f7] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 14:01:29.974 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:01:29.974 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:01:29.974 INFO 9 --- [host-check-agent-status1,be76a86a750e0f65,632d8ccae0c88e70] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:01:29.974 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:01:29.974 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:01:29.974 INFO 9 --- [host-check-agent-status5,be76a86a750e0f65,312b350d77593bdb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:01:29.975 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:01:29.975 INFO 9 --- [host-check-agent-status4,be76a86a750e0f65,9e08d1e731128d63] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:01:29.975 INFO 9 --- [host-check-agent-status2,be76a86a750e0f65,dc6875a6b91a9623] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:01:29.975 INFO 9 --- [host-check-agent-status6,be76a86a750e0f65,d57ade34c2359530] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:01:29.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:29.975 INFO 9 --- [host-check-agent-status3,be76a86a750e0f65,825d0df579b37190] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:01:29.975 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:01:29.975 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:01:29.974667227+08:00 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:01:29.974409052+08:00 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:01:29.975017126+08:00 2025-09-16 14:01:29.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:01:29.976+08:00 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:01:29.976+08:00 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:01:29.976+08:00 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:01:29.975099341+08:00 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:01:29.975478471+08:00 2025-09-16 14:01:29.976 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:01:29.975338730+08:00 2025-09-16 14:01:29.977 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:01:29.976+08:00 2025-09-16 14:01:29.977 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:01:29.976+08:00 2025-09-16 14:01:29.977 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:01:29.976+08:00 2025-09-16 14:01:29.978 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:01:29.976+08:00 and status AVAILABLE 2025-09-16 14:01:29.978 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:01:29.976+08:00 and status AVAILABLE 2025-09-16 14:01:29.978 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:01:29.976+08:00 and status AVAILABLE 2025-09-16 14:01:29.978 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:01:29.976+08:00 and status AVAILABLE 2025-09-16 14:01:29.978 INFO 9 --- [host-check-agent-status4,be76a86a750e0f65,9e08d1e731128d63] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:01:29.978 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:01:29.976+08:00 and status AVAILABLE 2025-09-16 14:01:29.978 INFO 9 --- [host-check-agent-status4,be76a86a750e0f65,9e08d1e731128d63] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:01:29.978 INFO 9 --- [host-check-agent-status4,be76a86a750e0f65,9e08d1e731128d63] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:01:29.978 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:01:29.976+08:00 and status AVAILABLE 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status5,be76a86a750e0f65,312b350d77593bdb] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status5,be76a86a750e0f65,312b350d77593bdb] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status5,be76a86a750e0f65,312b350d77593bdb] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status1,be76a86a750e0f65,632d8ccae0c88e70] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status1,be76a86a750e0f65,632d8ccae0c88e70] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status1,be76a86a750e0f65,632d8ccae0c88e70] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status2,be76a86a750e0f65,dc6875a6b91a9623] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status2,be76a86a750e0f65,dc6875a6b91a9623] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status2,be76a86a750e0f65,dc6875a6b91a9623] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status6,be76a86a750e0f65,d57ade34c2359530] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status6,be76a86a750e0f65,d57ade34c2359530] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:01:29.979 INFO 9 --- [host-check-agent-status6,be76a86a750e0f65,d57ade34c2359530] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:01:29.980 INFO 9 --- [host-check-agent-status3,be76a86a750e0f65,825d0df579b37190] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:01:29.980 INFO 9 --- [host-check-agent-status3,be76a86a750e0f65,825d0df579b37190] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:01:29.980 INFO 9 --- [host-check-agent-status3,be76a86a750e0f65,825d0df579b37190] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:01:29.981 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:01:29.981 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:01:29.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:01:29.981 INFO 9 --- [ocp-schedules-28,bcd969378614e6f7,c2874468154a23b7] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:01:29.982 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:01:29.982 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:01:29.982 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:01:29.982 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:01:29.987 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:01:29.987 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:01:29.988 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:01:29.988 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:01:29.988 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:29.988 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:01:29.989 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:01:29.989 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:01:29.989 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:29.989 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:01:29.990 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:01:29.990 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:01:29.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:29.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:01:30.002 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:30.002 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:30.002 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:30.002 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:30.004 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:30.004 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:01:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:01:30.004017+08:00, lastProcessTime=2025-09-16T14:01:20.003080+08:00 2025-09-16 14:01:30.029 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:01:30.030 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:01:30.030 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:01:30.030 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:01:30.031 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:01:30.032 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:30.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:30.034 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:01:30.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:01:30.035 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:01:30.036 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:01:30.036 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:01:30.037 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:01:30.038 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:01:30.041 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:01:30.047 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:30.048 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:30.048 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:30.049 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:30.050 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:30.052 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:01:30.069 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:01:30.074 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:01:30.075 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:30.077 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:01:30.077 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:01:30.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:01:30.078 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:01:30.079 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:30.080 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:01:30.081 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:01:30.082 INFO 9 --- [ocp-schedules-6,b6a725ac9aef1a24,30f6478b9fc07aad] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 14:01:30.083 INFO 9 --- [ocp-schedules-6,b6a725ac9aef1a24,30f6478b9fc07aad] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 14:01:30.083 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:01:30.084 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:01:30.085 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:01:30.086 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:01:30.086 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:01:30.092 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:01:30.094 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:30.095 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:30.096 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:30.097 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:30.097 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:30.101 INFO 9 --- [prometheus-second-schedule-1,2eb4db103c7ed640,6eccdb9c85594084] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 14:01:30.104 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:01:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.111 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:30.121 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:01:30.123 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:01:30.124 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:01:30.125 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:01:30.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:30.125 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:01:30.126 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:01:30.004017+08:00 2025-09-16 14:01:30.127 INFO 9 --- [host-check-host-status1,008204a63643144f,59aa3c541494ccd0] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:01:30.130 INFO 9 --- [host-check-host-status5,008204a63643144f,fadd5670daad1a0d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:01:30.131 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:01:30.131 INFO 9 --- [host-check-host-status4,008204a63643144f,8b91027f72d302e7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:01:30.131 INFO 9 --- [host-check-host-status3,008204a63643144f,6f534b4f94012574] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:01:30.132 INFO 9 --- [host-check-host-status6,008204a63643144f,6ce1d5c5d2a0d33b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:01:30.137 INFO 9 --- [host-check-host-status2,008204a63643144f,71d1d80ae896baba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:01:30.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:30.156 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.156 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:30.172 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.172 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:30.186 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.186 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:30.189 INFO 9 --- [ocp-async-5,c538159099b1649d,5201458c8657dcf7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:01:30.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:01:30.216 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.217 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:01:30.233 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:01:30.247 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:30.249 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:30.250 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:01:30.255 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:01:30.258 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:01:30.261 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:30.262 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:30.276 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:01:30.283 INFO 9 --- [ocp-schedules-9,70e70507445c63ba,130aef395c6977e2] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 14:01:30.284 INFO 9 --- [ocp-schedules-9,70e70507445c63ba,130aef395c6977e2] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:30.284 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 14:01:30.284 INFO 9 --- [ocp-schedules-9,70e70507445c63ba,130aef395c6977e2] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:01:30.335 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:01:30.349 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:30.351 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:30.352 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:01:30.367 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:01:30.367 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:01:30.367 INFO 9 --- [ocp-schedules-11,f9795e1682b47f08,f02603fe2315560f] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:01:30.415 INFO 9 --- [ocp-schedules-20,ebcae62fd14e9274,0051d334f8438507] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 14:01:30.604 INFO 9 --- [ocp-schedules-25,b6d88bf192edb851,8aa9f0e7a9c74740] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 14:01:30.606 INFO 9 --- [ocp-schedules-25,b6d88bf192edb851,8aa9f0e7a9c74740] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 14:01:30.606 INFO 9 --- [ocp-schedules-25,b6d88bf192edb851,8aa9f0e7a9c74740] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 14:01:30.620 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:30.621 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:30.817 WARN 9 --- [ocp-async-4,2fc1a037a10609fa,468d3feee5e9205a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:30.817 INFO 9 --- [ocp-async-8,7257fcc3f532d18f,2396027056dbcac9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:30.874 INFO 9 --- [ocp-schedules-6,66b6bda0b2f751da,9a2eef08a8a7153c] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:01:31.001 INFO 9 --- [ocp-schedules-7,b20aacf8d7529407,53546a0cc09f90de] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 14:01:31.001 INFO 9 --- [ocp-schedules-7,b20aacf8d7529407,53546a0cc09f90de] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 14:01:31.247 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,ea393d727c458fb4,d134dc4c0d6438de] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=ea393d727c458fb4, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 14:01:31.247 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,ea393d727c458fb4,d134dc4c0d6438de] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=ea393d727c458fb4, duration=0 ms] 2025-09-16 14:01:31.511 INFO 9 --- [ocp-schedules-15,7e744cb53335ee78,756e6258a83c1a7f] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 14:01:31.511 INFO 9 --- [ocp-schedules-15,7e744cb53335ee78,756e6258a83c1a7f] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002491 2025-09-16 14:01:31.512 INFO 9 --- [ocp-schedules-15,7e744cb53335ee78,756e6258a83c1a7f] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 14:01:31.636 INFO 9 --- [prometheus-minute-schedule-1,573b3f65f3487732,fea142e521f2d344] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:31.639 INFO 9 --- [prometheus-minute-schedule-1,573b3f65f3487732,fea142e521f2d344] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:31.688 INFO 9 --- [ocp-schedules-14,e44812c870bbb7d9,4b413fbad1df9403] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 14:01:31.720 INFO 9 --- [ocp-schedules-3,afe078ed9222ad65,fd028c28b8c00298] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 14:01:31.720 INFO 9 --- [ocp-schedules-3,afe078ed9222ad65,fd028c28b8c00298] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 14:01:31.721 INFO 9 --- [ocp-schedules-3,afe078ed9222ad65,fd028c28b8c00298] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 14:01:31.721 INFO 9 --- [ocp-schedules-3,afe078ed9222ad65,fd028c28b8c00298] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 14:01:31.721 INFO 9 --- [ocp-schedules-3,afe078ed9222ad65,fd028c28b8c00298] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 14:01:31.721 INFO 9 --- [ocp-schedules-3,afe078ed9222ad65,fd028c28b8c00298] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 14:01:31.747 INFO 9 --- [ocp-schedules-11,ec9b957b0502326d,42388ba325b54344] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 14:01:32.409 INFO 9 --- [ocp-schedules-6,ef1ba1c5a4cc584c,60a968905a14c0fc] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:01:32.413 WARN 9 --- [scanner-1388844-1,ef1ba1c5a4cc584c,eca37b9f10744778] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:01:32.817 INFO 9 --- [ocp-async-5,707ddcada5f994f7,e79aa90e4d0bb867] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:32.817 WARN 9 --- [ocp-async-6,b106113665a5db9f,d3319cb5c01d1f4b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:33.526 INFO 9 --- [ocp-schedules-16,4645d305955b148e,c3f35f93efae18b6] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 14:01:33.621 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:33.621 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:33.666 INFO 9 --- [ocp-schedules-13,5df88b5209fd5777,dc09276f8a2b05b7] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T14:01:33.666+08:00, clusters=[1] 2025-09-16 14:01:33.667 INFO 9 --- [ocp-schedules-13,5df88b5209fd5777,dc09276f8a2b05b7] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 14:01:34.237 INFO 9 --- [ocp-schedules-22,644bbf018c151e11,6c72fe74c323b04c] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 14:01:34.237 INFO 9 --- [ocp-schedules-22,644bbf018c151e11,6c72fe74c323b04c] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 14:01:34.237 INFO 9 --- [ocp-schedules-22,644bbf018c151e11,6c72fe74c323b04c] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 14:01:34.253 INFO 9 --- [ocp-schedules-22,644bbf018c151e11,6c72fe74c323b04c] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 14:01:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 14:01:34.636 INFO 9 --- [prometheus-minute-schedule-1,33f14607a62c137d,2ffb3d3ae1fd2f77] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:34.639 INFO 9 --- [prometheus-minute-schedule-1,33f14607a62c137d,2ffb3d3ae1fd2f77] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:34.793 INFO 9 --- [ocp-schedules-3,208a991bea7b9793,9fb85a7149e5d5c1] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:01:34.798 INFO 9 --- [ocp-schedules-3,208a991bea7b9793,9fb85a7149e5d5c1] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:01:34.798 INFO 9 --- [ocp-schedules-3,208a991bea7b9793,9fb85a7149e5d5c1] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:01:34.817 WARN 9 --- [ocp-async-2,1222243f6ff2a8dd,7c59197dc8fdffb6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:34.817 INFO 9 --- [ocp-async-9,f9bdd788c9e5e1cd,11411a0a0e0d0d19] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:34.913 INFO 9 --- [ocp-schedules-20,90980277907cac06,ad6b188ece8d63b5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:01:35.854 INFO 9 --- [ocp-schedules-27,6c7f3ec1ced72cbd,8f9636d54b1d1a2a] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T14:01:35.854+08:00, clusters=[1] 2025-09-16 14:01:35.858 INFO 9 --- [ocp-schedules-27,6c7f3ec1ced72cbd,8f9636d54b1d1a2a] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 14:01:36.621 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:36.622 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:36.817 WARN 9 --- [ocp-async-3,7b1f42950f86def4,f1e42c6be02036ca] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:36.817 INFO 9 --- [ocp-async-10,676a7e3d75105ffd,2c77fad19f07e1f8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:37.636 INFO 9 --- [prometheus-minute-schedule-1,91022b07914b757f,453d42d06ca8737f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:37.639 INFO 9 --- [prometheus-minute-schedule-1,91022b07914b757f,453d42d06ca8737f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:38.050 INFO 9 --- [ocp-schedules-1,781737c820296054,d900257405629599] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 14:01:38.052 INFO 9 --- [ocp-schedules-1,781737c820296054,d900257405629599] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:38.073 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:38.074 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 14:01:38.087 INFO 9 --- [ocp-schedules-1,781737c820296054,d900257405629599] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 14:01:38.818 WARN 9 --- [ocp-async-8,747b229a80f50e73,535f12af9d09c70b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:38.818 INFO 9 --- [ocp-async-6,3aa5891e0034f515,28d082118638a33a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:39.349 INFO 9 --- [ocp-schedules-27,73c845589158895d,d9b2b41772fa4369] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:01:39.352 INFO 9 --- [ocp-schedules-27,73c845589158895d,d9b2b41772fa4369] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:01:39.622 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:39.622 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:40.001 INFO 9 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 14:01:40.002 INFO 9 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 14:01:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:01:40.002895+08:00, lastProcessTime=2025-09-16T14:01:30.004017+08:00 2025-09-16 14:01:40.115 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:01:40.002895+08:00 2025-09-16 14:01:40.176 INFO 9 --- [ocp-schedules-5,67dce65d3e241caa,53967014870c15a9] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 14:01:40.176 INFO 9 --- [ocp-schedules-5,67dce65d3e241caa,53967014870c15a9] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 14:01:40.181 INFO 9 --- [ocp-schedules-14,f7d63542b6b89e22,ab92e2d06e4e9f62] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:01:40.182 INFO 9 --- [ocp-schedules-14,f7d63542b6b89e22,ab92e2d06e4e9f62] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 14:01:40.182 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 14:01:40.182 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 14:01:40.182 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 14:01:40.182 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 14:01:40.185 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:01:40.185 INFO 9 --- [ocp-schedules-14,f7d63542b6b89e22,ab92e2d06e4e9f62] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:01:40.185 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:01:40.186 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:40.186 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:01:40.186 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:01:40.186 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:01:40.186 INFO 9 --- [ocp-schedules-14,f7d63542b6b89e22,ab92e2d06e4e9f62] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:01:40.187 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:40.187 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:01:40.189 INFO 9 --- [ocp-async-4,5c7cff0d0326ed3b,0263733e7bede15d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:01:40.192 INFO 9 --- [Collect all tenants major compactions1,67dce65d3e241caa,b762659a02d4035c] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 14:01:40.192 INFO 9 --- [Collect all tenants major compactions2,67dce65d3e241caa,3285e80475a6bd39] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:01:40.192 INFO 9 --- [Collect all tenants major compactions3,67dce65d3e241caa,7b2980278724a574] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 14:01:40.201 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 14:01:40.201 INFO 9 --- [ocp-schedules-14,f7d63542b6b89e22,ab92e2d06e4e9f62] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 14:01:40.201 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 14:01:40.201 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 14:01:40.201 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 14:01:40.204 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 14:01:40.207 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:01:40.208 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:01:40.211 INFO 9 --- [Collect all tenants major compactions2,67dce65d3e241caa,3285e80475a6bd39] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:40.211 INFO 9 --- [Collect all tenants major compactions1,67dce65d3e241caa,b762659a02d4035c] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:40.211 INFO 9 --- [Collect all tenants major compactions3,67dce65d3e241caa,7b2980278724a574] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:40.212 INFO 9 --- [Collect all tenants major compactions1,67dce65d3e241caa,b762659a02d4035c] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 14:01:40.212 INFO 9 --- [Collect all tenants major compactions2,67dce65d3e241caa,3285e80475a6bd39] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 14:01:40.213 INFO 9 --- [Collect all tenants major compactions3,67dce65d3e241caa,7b2980278724a574] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 14:01:40.217 INFO 9 --- [Collect all tenants major compactions1,67dce65d3e241caa,b762659a02d4035c] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:01:40.217 INFO 9 --- [Collect all tenants major compactions3,67dce65d3e241caa,7b2980278724a574] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:01:40.220 INFO 9 --- [Collect all tenants major compactions2,67dce65d3e241caa,3285e80475a6bd39] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:01:40.221 INFO 9 --- [ocp-schedules-5,67dce65d3e241caa,53967014870c15a9] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 14:01:40.222 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 14:01:40.224 INFO 9 --- [ocp-schedules-14,f7d63542b6b89e22,ab92e2d06e4e9f62] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 14:01:40.636 INFO 9 --- [prometheus-minute-schedule-1,18c3c1b68564b379,b505f8ee9faf939e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:40.640 INFO 9 --- [prometheus-minute-schedule-1,18c3c1b68564b379,b505f8ee9faf939e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:40.818 WARN 9 --- [ocp-async-2,146f9e0c08c737bf,3fa1062d0c66bc2e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:40.818 INFO 9 --- [ocp-async-9,b03f8341afb3ea30,a2b648a583b5724e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:41.507 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:57:41.344, end=2025-09-16T13:59:41.504} 2025-09-16 14:01:41.510 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbit 2025-09-16 14:01:41.510 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 14:01:41.517 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 83 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:57:41.344, end=2025-09-16T13:59:41.504},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 14:01:41.614 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 14:01:41.614 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 14:01:41.677 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757916101677000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1, sqlId=E9E2014C8CE705871C555597A6A32456, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=1, obTenantId=1, tenantName=sys, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T06:01:41.677Z, endTime=2025-09-16T05:59:41.504Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=1, name=sys, obTenantId=1, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerSta 2025-09-16 14:01:41.683 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 0 2025-09-16 14:01:41.683 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 14:01:41.696 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 14:01:41.697 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 14:01:41.703 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 14:01:41.703 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 14:01:41.715 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 14:01:41.715 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1, obServerId=null, obDbId=201001, sqlId=E9E2014C8CE705871C555597A6A32456, sqlIdList=null, dynamicSql=false) 2025-09-16 14:01:41.721 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records,use plan union hash 2025-09-16 14:01:41.721 INFO 9 --- [plan_change_detector2,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 0 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T14:01:41.677, end=2025-09-16T13:59:41.504}, clusterId=1, tenantId=1, sqlId=E9E2014C8CE705871C555597A6A32456, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 14:01:41.722 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 14:01:41.723 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:57:41.344, end=2025-09-16T13:59:41.504},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 14:01:41.723 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 14:01:41.723 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 14:01:41.765 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757916101765000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T06:01:41.765Z, endTime=2025-09-16T05:59:41.504Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 14:01:41.769 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Query plan stat with:QueryPlanRawStatBySql(timeout=30000000, level=0, startTimeUs=1757916101769000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, sqlId=059C3EF76E9644CCC465E3910B3A28F8, obServerId=null, obDbId=201001, dynamicSql=false), context:SqlStatDataContext(clusterId=1, obClusterId=1, clusterName=zhengqi, tenantId=3, obTenantId=1004, tenantName=vas_ucs, mode=MYSQL, serverId=null, obServerId=null, obVersion=4.3.5.3, startTime=2025-09-15T06:01:41.769Z, endTime=2025-09-16T05:59:41.504Z, parseSqlType=false, parseStatement=false, parseTable=false, obServerIds=[1, 2, 3, 4, 5], serverMap={1=192.168.0.159:2882, 2=192.168.0.111:2882, 3=192.168.0.104:2882, 4=192.168.0.85:2882, 5=192.168.0.54:2882}, serverIpMap={192.168.0.111=2, 192.168.0.85=4, 192.168.0.54=5, 192.168.0.159=1, 192.168.0.104=3}, cluster=ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING}, tenant=ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL}, servers=[ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status= 2025-09-16 14:01:41.772 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 37 2025-09-16 14:01:41.772 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 14:01:41.778 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Top plan query ret: 39 2025-09-16 14:01:41.778 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan id 2025-09-16 14:01:41.787 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 14:01:41.787 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 14:01:41.792 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 14:01:41.792 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=059C3EF76E9644CCC465E3910B3A28F8, sqlIdList=null, dynamicSql=false) 2025-09-16 14:01:41.794 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 14:01:41.794 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 14:01:41.799 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 0 records, use plan hash 2025-09-16 14:01:41.799 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : query plan use plan union hash 2025-09-16 14:01:41.808 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 14:01:41.808 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, sqlIdList=null, dynamicSql=false) 2025-09-16 14:01:41.813 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to query plan info 2025-09-16 14:01:41.813 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : queryIncrementBySql with:QueryPlan(timeout=30000000, limit=3000, startTimeUs=1757894400000000, endTimeUs=1758002381504000, obClusterId=1, clusterName=zhengqi, obTenantId=1004, obServerId=null, obDbId=201001, sqlId=059C3EF76E9644CCC465E3910B3A28F8, sqlIdList=null, dynamicSql=false) 2025-09-16 14:01:41.815 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 14:01:41.819 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.i.PlanRawStatServiceImpl : Begin to map to models for 3 records,use plan union hash 2025-09-16 14:01:41.841 INFO 9 --- [plan_change_detector6,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T14:01:41.765, end=2025-09-16T13:59:41.504}, clusterId=1, tenantId=3, sqlId=721EADE6E9A63CCE76F8216F85A2EE6C, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 14:01:41.842 INFO 9 --- [plan_change_detector3,,] c.o.o.p.s.d.i.a.PlanBindingAdvisor : Got 1 plans with param:QueryTopPlanParam(interval=Interval{start=2025-09-15T14:01:41.769, end=2025-09-16T13:59:41.504}, clusterId=1, tenantId=3, sqlId=059C3EF76E9644CCC465E3910B3A28F8, serverId=null, dbName=oceanbase, obDbId=201001, attachDiagnosis=false, attachPlanExplain=true, attachOutlineBindingStatus=false, dynamicSql=false) 2025-09-16 14:01:41.843 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 14:01:41.844 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:57:41.344, end=2025-09-16T13:59:41.504},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 14:01:41.844 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 14:01:41.844 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 14:01:41.849 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 14:01:42.437 INFO 9 --- [ocp-schedules-22,640dfa7eaecaaf62,e7e205f1b3314603] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:01:42.442 WARN 9 --- [scanner-1388968-1,640dfa7eaecaaf62,a04fe60b3fe21d2c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:01:42.452 INFO 9 --- [alarm-detect-8,640dfa7eaecaaf62,4700dbdb13a64816] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:01:42.454 INFO 9 --- [alarm-detect-14,640dfa7eaecaaf62,f1fbdb227b4f2da6] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:01:42.454 INFO 9 --- [alarm-detect-20,640dfa7eaecaaf62,57ba7c8e53051e23] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:01:42.466 INFO 9 --- [alarm-detect-2,640dfa7eaecaaf62,9a3afceb65bb2bf1] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:01:42.622 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:42.623 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:42.728 INFO 9 --- [ocp-schedules-15,a7ff614ca53aa913,4e56ab4de43f0c0d] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 14:01:42.728 INFO 9 --- [ocp-schedules-15,a7ff614ca53aa913,4e56ab4de43f0c0d] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 14:01:42.747 INFO 9 --- [ocp-schedules-15,a7ff614ca53aa913,4e56ab4de43f0c0d] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 14:01:42.762 INFO 9 --- [ocp-schedules-15,a7ff614ca53aa913,4e56ab4de43f0c0d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:42.763 INFO 9 --- [ocp-schedules-15,a7ff614ca53aa913,4e56ab4de43f0c0d] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 14:01:42.818 WARN 9 --- [ocp-async-4,505abb91739282ed,6019f7ce23727886] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:42.818 INFO 9 --- [ocp-async-10,7facf65f2301983c,065fac70a659c189] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:43.636 INFO 9 --- [prometheus-minute-schedule-1,98a551d343aa63eb,70ef60250a7f3d1a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:43.639 INFO 9 --- [prometheus-minute-schedule-1,98a551d343aa63eb,70ef60250a7f3d1a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:44.818 WARN 9 --- [ocp-async-1,167ff0a708e58ac3,30b2eaede2176ea0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:44.818 INFO 9 --- [ocp-async-6,1d3931981e6e6496,ee245dd88f570a6e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:44.917 INFO 9 --- [ocp-schedules-20,f68f2db518488e1e,c7b51b2c5c087347] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:01:45.623 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:45.623 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:46.636 INFO 9 --- [prometheus-minute-schedule-1,9cbc66b26f7c92e3,75e1f5b2c4168e97] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:46.639 INFO 9 --- [prometheus-minute-schedule-1,9cbc66b26f7c92e3,75e1f5b2c4168e97] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:46.818 WARN 9 --- [ocp-async-7,e8ca71a876090ed3,d6cb4221e1b731c9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:46.818 INFO 9 --- [ocp-async-2,8785aa30cbd87814,531616f83d9e1557] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:47.182 INFO 9 --- [ocp-schedules-25,708b2ec967e4e39c,d1092e7c0db94694] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 14:01:47.183 INFO 9 --- [ocp-schedules-25,708b2ec967e4e39c,d1092e7c0db94694] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:47.226 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:01:47.226 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.229 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:01:47.254 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.255 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:01:47.277 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.278 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:01:47.301 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.301 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:01:47.305 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.306 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:01:47.330 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.330 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:01:47.353 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.354 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:01:47.358 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.359 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:01:47.384 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.385 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:01:47.408 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.409 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:01:47.426 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.427 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 14:01:47.428 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.429 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:01:47.429 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.430 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:01:47.431 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.432 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 14:01:47.433 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.433 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:01:47.434 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.435 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:01:47.449 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.450 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 14:01:47.451 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.451 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:01:47.452 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.453 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:01:47.468 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 14:01:47.470 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 14:01:47.497 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:01:47.498 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:47.499 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 14:01:47.530 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:01:47.530 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 14:01:47.530 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:01:47.530 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 14:01:47.530 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:01:47.530 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 14:01:47.532 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 14:01:47.532 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:01:47.532 INFO 9 --- [ocp-schedules-25,708b2ec967e4e39c,d1092e7c0db94694] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 14:01:48,031 |-INFO in ReconfigureOnChangeTask(born:1758002328031) - Empty watch file list. Disabling 2025-09-16 14:01:48.386 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 14:01:48.386 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 14:01:48.389 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 14:01:48.389 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 14:01:48.389 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 14:01:48.389 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 14:01:48.391 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 14:01:48.391 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 14:01:48.391 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 14:01:48.391 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 14:01:48.409 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 14:01:48.413 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 14:01:48.413 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 14:01:48.413 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 14:01:48.413 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 14:01:48.413 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 14:01:48.417 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 14:01:48.623 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:48.624 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:48.673 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 14:01:48.818 WARN 9 --- [ocp-async-9,a008dc0806f0ed1f,0691f2b75cdf0ef6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:48.818 INFO 9 --- [ocp-async-4,2cf19aa248470a6e,dbf181901b519872] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:48.943 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.551624403S 2025-09-16 14:01:48.943 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 14:01:48.995 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 14:01:48.995 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 14:01:49.024 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 14:01:49,036 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 14:01:49,037 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 14:01:49,037 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 14:01:49,038 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 14:01:49,038 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 14:01:49,038 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 14:01:49,036 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 14:01:49,037 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 14:01:49,037 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 14:01:49,038 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 14:01:49,038 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 14:01:49,038 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 14:01:49,039 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@762c2a0 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 14:01:49,042 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 14:01:49,042 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 14:01:49,043 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 14:01:49,043 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@762c2a0 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 14:01:49,044 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 14:01:49,044 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 14:01:49,044 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 14:01:49,044 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 14:01:49,044 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 14:01:49,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 14:01:49,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 14:01:49,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 14:01:49,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 14:01:49,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 14:01:49,045 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 14:01:49,046 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 14:01:49,046 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 14:01:49,046 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 14:01:49,046 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 14:01:49,046 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 14:01:49,046 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1719383893 - setting totalSizeCap to 10 GB 14:01:49,046 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1719383893 - Archive files will be limited to [100 MB] each. 14:01:49,046 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1719383893 - Will use gz compression 14:01:49,046 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1719383893 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 14:01:49,046 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@779d0ef8 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 14:01:49,046 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@779d0ef8 - Roll-over at midnight. 14:01:49,046 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@779d0ef8 - Setting initial period to Tue Sep 16 14:01:49 CST 2025 14:01:49,046 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1719383893 - Cleaning on start up 14:01:49,046 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 14:01:49,046 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 14:01:49,047 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 14:01:49,047 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 14:01:49,047 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 14:01:49,047 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 14:01:49,047 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 14:01:49,047 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 14:01:49,047 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 14:01:49,047 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 14:01:49,047 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 14:01:49,047 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@681659417 - setting totalSizeCap to 10 GB 14:01:49,047 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@681659417 - Archive files will be limited to [100 MB] each. 14:01:49,047 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@681659417 - Will use gz compression 14:01:49,047 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@681659417 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 14:01:49,047 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13db8747 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 14:01:49,047 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13db8747 - Roll-over at midnight. 14:01:49,047 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@13db8747 - Setting initial period to Tue Sep 16 14:01:31 CST 2025 14:01:49,048 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 14:01:49,048 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 14:01:49,048 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 14:01:49,048 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 14:01:49,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 14:01:49,048 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 14:01:49,048 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 14:01:49,048 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 14:01:49,048 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 14:01:49,048 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 14:01:49,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 14:01:49,048 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 14:01:49,048 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating INFO level on Logger[ROOT] onto the JUL framework 14:01:49,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 14:01:49,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 14:01:49,048 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 14:01:49,048 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 14:01:49,048 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@c2ea10a - Registering current configuration as safe fallback point 14:01:49,050 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 14:01:49,052 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating INFO level on Logger[web] onto the JUL framework 14:01:49,052 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 14:01:49,052 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@7c2e4940 - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 14:01:49.053 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 14:01:49.053 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 14:01:49.053 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 14:01:49.053 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 14:01:49.053 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 14:01:49.053 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 14:01:49.059 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 14:01:49.145 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] o.s.boot.SpringApplication : Started application in 0.756 seconds (JVM running for 13484.19) 2025-09-16 14:01:49.145 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.756933026S 2025-09-16 14:01:49.356 INFO 9 --- [ocp-schedules-30,a4e27871655b24ff,8f58fcf588e18f1b] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:01:49.358 INFO 9 --- [ocp-schedules-30,a4e27871655b24ff,8f58fcf588e18f1b] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:01:49.393 INFO 9 --- [ocp-schedules-20,1ab9e7e6704ed914,72c8f878e1b64e18] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 14:01:49.636 INFO 9 --- [prometheus-minute-schedule-1,2861d405067e84b9,1d37f36fef09cf4b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:49.639 INFO 9 --- [prometheus-minute-schedule-1,2861d405067e84b9,1d37f36fef09cf4b] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:50.006 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:01:50.004516+08:00, lastProcessTime=2025-09-16T14:01:40.002895+08:00 2025-09-16 14:01:50.119 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:01:50.004516+08:00 2025-09-16 14:01:50.189 INFO 9 --- [ocp-async-6,4712cfed823c16b2,3e9590889dc34fa3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:01:50.818 WARN 9 --- [ocp-async-1,67e03460645cc7c9,65c13fc5467b6c77] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:50.818 INFO 9 --- [ocp-async-5,d8765fa70fe777b5,6a15906e6263dfd4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:51.624 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:51.624 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:52.470 INFO 9 --- [ocp-schedules-18,fd751ecd1e8b7cab,30034d18c9425fb1] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:01:52.475 WARN 9 --- [scanner-1389131-1,fd751ecd1e8b7cab,eb922845f716fec0] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:01:52.636 INFO 9 --- [prometheus-minute-schedule-1,7f0bbb7605f925d5,37def8f3f5d821dd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:52.639 INFO 9 --- [prometheus-minute-schedule-1,7f0bbb7605f925d5,37def8f3f5d821dd] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:52.818 WARN 9 --- [ocp-async-6,decc3e95606a5d88,0931c66bbda42c37] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:52.818 INFO 9 --- [ocp-async-7,96791c01d7e7305d,ee22e8ba89f77a94] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:54.625 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:54.625 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:54.800 INFO 9 --- [ocp-schedules-22,e203c3cd65e67a5d,4f2da91aa363b2b4] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:01:54.805 INFO 9 --- [ocp-schedules-22,e203c3cd65e67a5d,4f2da91aa363b2b4] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:01:54.805 INFO 9 --- [ocp-schedules-22,e203c3cd65e67a5d,4f2da91aa363b2b4] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:01:54.818 WARN 9 --- [ocp-async-9,8c27c1b2081503a5,929cf890eff1871c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:54.818 INFO 9 --- [ocp-async-8,de771decbd4144ac,694a43920a616b49] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:54.920 INFO 9 --- [ocp-schedules-2,03e96c3fe2383744,f30cdcfc388bd0e4] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:01:55.481 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,344b78ec4a628814,962099c9bb8ea4e0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=10.232.140.0, traceId=344b78ec4a628814, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:01:55.481 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,7e50bc19b7230aa9,b36c2d4aa6788160] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/idcs?null, client=10.232.140.0, traceId=7e50bc19b7230aa9, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listIdcs(Pageable,Boolean), args=Page request [number: 0, size 5000, sort: id: DESC],false,] 2025-09-16 14:01:55.482 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,6ff9654cb293d5af,352e8e79a256004a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/regions?null, client=10.232.140.0, traceId=6ff9654cb293d5af, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listRegions(Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:01:55.488 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,344b78ec4a628814,962099c9bb8ea4e0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=10.232.140.0, traceId=344b78ec4a628814, duration=11 ms] 2025-09-16 14:01:55.488 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,6ff9654cb293d5af,352e8e79a256004a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/regions client=10.232.140.0, traceId=6ff9654cb293d5af, duration=14 ms] 2025-09-16 14:01:55.490 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,5acb00cec4ac16f3,f0e48c30e5ab2eb5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?page=1&size=10, client=10.232.140.0, traceId=5acb00cec4ac16f3, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHosts(List,String,List,List,List,List,List,List,List,List,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2025-09-16 14:01:55.492 WARN 9 --- [http-nio-0.0.0.0-8080-exec-2,5acb00cec4ac16f3,f0e48c30e5ab2eb5] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2025-09-16 14:01:55.492 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,7e50bc19b7230aa9,b36c2d4aa6788160] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/idcs client=10.232.140.0, traceId=7e50bc19b7230aa9, duration=17 ms] 2025-09-16 14:01:55.543 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,5acb00cec4ac16f3,f0e48c30e5ab2eb5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=10.232.140.0, traceId=5acb00cec4ac16f3, duration=55 ms] 2025-09-16 14:01:55.636 INFO 9 --- [prometheus-minute-schedule-1,dcdeb334bbf6b9df,62ce3f76e2777607] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:55.639 INFO 9 --- [prometheus-minute-schedule-1,dcdeb334bbf6b9df,62ce3f76e2777607] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:56.403 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,90d128b7b1cfdf8d,45103f59b4260502] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.232.140.0, traceId=90d128b7b1cfdf8d, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2025-09-16 14:01:56.407 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,90d128b7b1cfdf8d,45103f59b4260502] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.232.140.0, traceId=90d128b7b1cfdf8d, duration=7 ms] 2025-09-16 14:01:56.544 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,b06dcb44aea6d7e7,04a349736f350a8e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=TENANT&type=TOP, client=10.232.140.0, traceId=b06dcb44aea6d7e7, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,VersionTarget,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,TENANT,OBCLUSTER,] 2025-09-16 14:01:56.551 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,b06dcb44aea6d7e7,04a349736f350a8e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.232.140.0, traceId=b06dcb44aea6d7e7, duration=10 ms] 2025-09-16 14:01:56.566 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,6f42ee09fcef159d,53b4a2a4522f0e43] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenantsView?page=1&size=10, client=10.232.140.0, traceId=6f42ee09fcef159d, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObTenantController.listAllTenantsView(Pageable,String,List,Boolean,String,Boolean,List,List), args=Page request [number: 0, size 10, sort: id: DESC],] 2025-09-16 14:01:56.583 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,6f42ee09fcef159d,53b4a2a4522f0e43] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenantsView client=10.232.140.0, traceId=6f42ee09fcef159d, duration=20 ms] 2025-09-16 14:01:56.794 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,1777f35a4ad20390,a4cfc4877f3f1cbf] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2025-09-16T13%3A01%3A56%2B08%3A00&endTime=2025-09-16T14%3A01%3A56%2B08%3A00&metrics=sql_all_count&queryAsync=true&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name&limit=5&maxPoints=360, client=10.232.140.0, traceId=1777f35a4ad20390, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2025-09-16T13:01:56+08:00,2025-09-16T14:01:56+08:00,sql_all_count,app,ob_cluster_name,ob_cluster_id,tenant_name,0,0,5,360,app:OB,true,] 2025-09-16 14:01:56.794 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,0c749de4989487f8,fa380ad31c4af58e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2025-09-16T13%3A01%3A56%2B08%3A00&endTime=2025-09-16T14%3A01%3A56%2B08%3A00&metrics=tps&queryAsync=true&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name&limit=5&maxPoints=360, client=10.232.140.0, traceId=0c749de4989487f8, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2025-09-16T13:01:56+08:00,2025-09-16T14:01:56+08:00,tps,app,ob_cluster_name,ob_cluster_id,tenant_name,0,0,5,360,app:OB,true,] 2025-09-16 14:01:56.817 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,0c749de4989487f8,fa380ad31c4af58e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=10.232.140.0, traceId=0c749de4989487f8, duration=26 ms] 2025-09-16 14:01:56.817 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,1777f35a4ad20390,a4cfc4877f3f1cbf] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=10.232.140.0, traceId=1777f35a4ad20390, duration=26 ms] 2025-09-16 14:01:56.819 WARN 9 --- [ocp-async-10,54a24c7e60e236ea,c15d06925a68f19f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:56.819 INFO 9 --- [ocp-async-1,6523e7aa78a79f1c,b7378d1946a9d282] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:57.519 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,ec8c8c7bc1f829be,092b5c8309356add] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=ODP&type=TOP, client=10.232.140.0, traceId=ec8c8c7bc1f829be, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,VersionTarget,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,ODP,OBCLUSTER,] 2025-09-16 14:01:57.525 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,ec8c8c7bc1f829be,092b5c8309356add] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.232.140.0, traceId=ec8c8c7bc1f829be, duration=9 ms] 2025-09-16 14:01:57.531 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,3509483327083f8a,84648777c0a0f3d0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters?page=1&size=10, client=10.232.140.0, traceId=3509483327083f8a, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listObproxyClusters(Pageable,List,String,List,Boolean), args=Page request [number: 0, size 10, sort: id: ASC],false,] 2025-09-16 14:01:57.532 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,3509483327083f8a,84648777c0a0f3d0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters client=10.232.140.0, traceId=3509483327083f8a, duration=4 ms] 2025-09-16 14:01:57.625 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:01:57.626 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:01:57.828 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,e4ed8a1c11a1d1f7,9fbf9cfbfadac371] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2025-09-16T13%3A01%3A57%2B08%3A00&endTime=2025-09-16T14%3A01%3A57%2B08%3A00&metrics=transaction_total&queryAsync=true&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5&maxPoints=360, client=10.232.140.0, traceId=e4ed8a1c11a1d1f7, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2025-09-16T13:01:57+08:00,2025-09-16T14:01:57+08:00,transaction_total,app,obproxy_cluster,0,0,5,360,app:ODP,true,] 2025-09-16 14:01:57.828 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,47454bc1e157f434,68d36928761b9424] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?startTime=2025-09-16T13%3A01%3A57%2B08%3A00&endTime=2025-09-16T14%3A01%3A57%2B08%3A00&metrics=request_total&queryAsync=true&labels=app%3AODP&groupBy=app%2Cobproxy_cluster&limit=5&maxPoints=360, client=10.232.140.0, traceId=47454bc1e157f434, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2025-09-16T13:01:57+08:00,2025-09-16T14:01:57+08:00,request_total,app,obproxy_cluster,0,0,5,360,app:ODP,true,] 2025-09-16 14:01:57.829 WARN 9 --- [http-nio-0.0.0.0-8080-exec-10,47454bc1e157f434,68d36928761b9424] c.o.o.m.s.MonitorAsyncComputeServiceImpl : Scan data async get empty result, metric = request_total 2025-09-16 14:01:57.829 WARN 9 --- [http-nio-0.0.0.0-8080-exec-10,47454bc1e157f434,68d36928761b9424] c.o.o.m.s.MonitorAsyncComputeServiceImpl : Scan data async result range is away from start time, fall back to full query. metric = request_total, minTimestamp = 0, minTimeBuffer = 0, startTime = 1757998920 2025-09-16 14:01:57.829 WARN 9 --- [http-nio-0.0.0.0-8080-exec-9,e4ed8a1c11a1d1f7,9fbf9cfbfadac371] c.o.o.m.s.MonitorAsyncComputeServiceImpl : Scan data async get empty result, metric = transaction_total 2025-09-16 14:01:57.829 WARN 9 --- [http-nio-0.0.0.0-8080-exec-9,e4ed8a1c11a1d1f7,9fbf9cfbfadac371] c.o.o.m.s.MonitorAsyncComputeServiceImpl : Scan data async result range is away from start time, fall back to full query. metric = transaction_total, minTimestamp = 0, minTimeBuffer = 0, startTime = 1757998920 2025-09-16 14:01:57.829 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,47454bc1e157f434,68d36928761b9424] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=10.232.140.0, traceId=47454bc1e157f434, duration=4 ms] 2025-09-16 14:01:57.829 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,e4ed8a1c11a1d1f7,9fbf9cfbfadac371] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=10.232.140.0, traceId=e4ed8a1c11a1d1f7, duration=4 ms] 2025-09-16 14:01:58.520 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,a1a2fe0ee34f6c63,b38e9c5600acbd11] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.232.140.0, traceId=a1a2fe0ee34f6c63, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2025-09-16 14:01:58.524 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,a1a2fe0ee34f6c63,b38e9c5600acbd11] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.232.140.0, traceId=a1a2fe0ee34f6c63, duration=7 ms] 2025-09-16 14:01:58.636 INFO 9 --- [prometheus-minute-schedule-1,e3633ec9e23a8547,14985bdf45ded8a7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002520, interval=60 2025-09-16 14:01:58.639 INFO 9 --- [prometheus-minute-schedule-1,e3633ec9e23a8547,14985bdf45ded8a7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:01:58.819 WARN 9 --- [ocp-async-5,c6ec4eae18f5e571,a99ef7bac217f910] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:01:58.819 INFO 9 --- [ocp-async-2,5591a381d60ae075,3614cfbc3ae68535] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:01:59.012 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,f86cf78928a8c3c5,f965d6abb778b644] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/software-packages?type=OBPROXY_INSTALL_PACKAGE&withInstallationData=true, client=10.232.140.0, traceId=f86cf78928a8c3c5, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.SoftwarePackageController.listPackages(String,List,List,List,List,boolean,Pageable), args=[OBPROXY_INSTALL_PACKAGE],true,Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:01:59.012 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,818c3636035e0396,8c2fd36e44bad4b8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?withRemote=RELATED, client=10.232.140.0, traceId=818c3636035e0396, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,RELATED,Page request [number: 0, size 5000, sort: name: ASC,obClusterId: ASC],] 2025-09-16 14:01:59.013 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,2e5679e76af00a88,8a9ac83dc229160f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=10.232.140.0, traceId=2e5679e76af00a88, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:01:59.013 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,ecb9202077819b65,eb1d2f42b24b7646] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/idcs?null, client=10.232.140.0, traceId=ecb9202077819b65, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listIdcs(Pageable,Boolean), args=Page request [number: 0, size 5000, sort: id: DESC],false,] 2025-09-16 14:01:59.015 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,2e5679e76af00a88,8a9ac83dc229160f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=10.232.140.0, traceId=2e5679e76af00a88, duration=4 ms] 2025-09-16 14:01:59.016 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,ecb9202077819b65,eb1d2f42b24b7646] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/idcs client=10.232.140.0, traceId=ecb9202077819b65, duration=5 ms] 2025-09-16 14:01:59.020 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,818c3636035e0396,8c2fd36e44bad4b8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=10.232.140.0, traceId=818c3636035e0396, duration=10 ms] 2025-09-16 14:01:59.036 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,f86cf78928a8c3c5,f965d6abb778b644] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/software-packages client=10.232.140.0, traceId=f86cf78928a8c3c5, duration=27 ms] 2025-09-16 14:01:59.051 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,c189813e2167a91d,5b277382c9ba48f9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/lb/service?factoryName=slbObjectFactory, client=10.232.140.0, traceId=c189813e2167a91d, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listLBService(String), args=slbObjectFactory,] 2025-09-16 14:01:59.051 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,1769b3faae44b33d,222a5bf6fe57f26c] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?status=ONLINE&status=AVAILABLE&excludedServiceType=OB_PROXY&excludedServiceType=BINLOG_SERVICE, client=10.232.140.0, traceId=1769b3faae44b33d, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHosts(List,String,List,List,List,List,List,List,List,List,Pageable), args=[ONLINE, AVAILABLE],[OB_PROXY, BINLOG_SERVICE],Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:01:59.055 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,c189813e2167a91d,5b277382c9ba48f9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/lb/service client=10.232.140.0, traceId=c189813e2167a91d, duration=6 ms] 2025-09-16 14:01:59.056 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,be9acc510ef6b33d,8aeda9f9314c72ce] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/lb/service?factoryName=oblbObjectFactory, client=10.232.140.0, traceId=be9acc510ef6b33d, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listLBService(String), args=oblbObjectFactory,] 2025-09-16 14:01:59.056 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,be9acc510ef6b33d,8aeda9f9314c72ce] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/lb/service client=10.232.140.0, traceId=be9acc510ef6b33d, duration=3 ms] 2025-09-16 14:01:59.057 WARN 9 --- [http-nio-0.0.0.0-8080-exec-6,1769b3faae44b33d,222a5bf6fe57f26c] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2025-09-16 14:01:59.059 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,4df4d8a4bcc219a5,affafbdad5927eb5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.232.140.0, traceId=4df4d8a4bcc219a5, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2025-09-16 14:01:59.059 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,f6361d9fa94c39c7,9136e1de49ec65d5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=10.232.140.0, traceId=f6361d9fa94c39c7, method=SuccessResponse com.oceanbase.ocp.server.common.controller.PropertyController.getSystemInfo(), args=] 2025-09-16 14:01:59.059 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,f6361d9fa94c39c7,9136e1de49ec65d5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=10.232.140.0, traceId=f6361d9fa94c39c7, duration=2 ms] 2025-09-16 14:01:59.063 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,4df4d8a4bcc219a5,affafbdad5927eb5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.232.140.0, traceId=4df4d8a4bcc219a5, duration=7 ms] 2025-09-16 14:01:59.097 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,1769b3faae44b33d,222a5bf6fe57f26c] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=10.232.140.0, traceId=1769b3faae44b33d, duration=48 ms] 2025-09-16 14:01:59.101 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,0b0597bd21cc57de,19a8ba6a54fbb293] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/state-statistics?null, client=10.232.140.0, traceId=0b0597bd21cc57de, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskStateSummary(TaskType), args=MANUAL,] 2025-09-16 14:01:59.101 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,7a64823cb96cf6a3,14bcb1ea363f13fc] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=10.232.140.0, traceId=7a64823cb96cf6a3, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:01:59.102 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,7775cb5f8998a276,0d1db89f3f0f1e66] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=10.232.140.0, traceId=7775cb5f8998a276, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2025-09-16 14:01:59.102 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,0b0597bd21cc57de,19a8ba6a54fbb293] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/state-statistics client=10.232.140.0, traceId=0b0597bd21cc57de, duration=3 ms] 2025-09-16 14:01:59.104 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,436371edbb26b1d1,193f25b77858587f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/idcs?null, client=10.232.140.0, traceId=436371edbb26b1d1, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listIdcs(Pageable,Boolean), args=Page request [number: 0, size 5000, sort: id: DESC],false,] 2025-09-16 14:01:59.104 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,7a64823cb96cf6a3,14bcb1ea363f13fc] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=10.232.140.0, traceId=7a64823cb96cf6a3, duration=6 ms] 2025-09-16 14:01:59.106 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,436371edbb26b1d1,193f25b77858587f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/idcs client=10.232.140.0, traceId=436371edbb26b1d1, duration=4 ms] 2025-09-16 14:01:59.181 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.232.140.0, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2025-09-16 14:01:59.181 WARN 9 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, method=10.232.140.0, client=GET, traceId=] 2025-09-16 14:01:59.181 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.232.140.0, traceId=, duration=0 ms] 2025-09-16 14:01:59.241 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,7775cb5f8998a276,0d1db89f3f0f1e66] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.232.140.0, traceId=7775cb5f8998a276, duration=142 ms] 2025-09-16 14:01:59.266 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,f8083d188c413bc8,c5eb7f34f90fcd02] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/telemetry?null, client=10.232.140.0, traceId=f8083d188c413bc8, method=SuccessResponse com.oceanbase.ocp.controller.TelemetryController.get(), args=] 2025-09-16 14:01:59.291 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,f8083d188c413bc8,c5eb7f34f90fcd02] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/telemetry client=10.232.140.0, traceId=f8083d188c413bc8, duration=27 ms] 2025-09-16 14:01:59.301 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,c7f19fc42ac671cb,e9ec743fecf57c96] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?withRemote=RELATED, client=10.232.140.0, traceId=c7f19fc42ac671cb, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,RELATED,Page request [number: 0, size 5000, sort: name: ASC,obClusterId: ASC],] 2025-09-16 14:01:59.308 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,c7f19fc42ac671cb,e9ec743fecf57c96] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=10.232.140.0, traceId=c7f19fc42ac671cb, duration=9 ms] 2025-09-16 14:01:59.364 INFO 9 --- [ocp-schedules-5,2106ff0d65ec7112,4e1fc93eb627f6ea] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:01:59.366 INFO 9 --- [ocp-schedules-5,2106ff0d65ec7112,4e1fc93eb627f6ea] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:01:59.938 INFO 9 --- [ocp-schedules-14,df5b4299853a14b4,f13555e0914abe3c] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:01:59.941 INFO 9 --- [ocp-schedules-22,c2ad63a06a890f9c,04d4e22b1cd944d0] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:01:59.941 INFO 9 --- [ocp-schedules-13,d1c69266e248ae5c,211dd490ed5febf9] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:01:59.942 INFO 9 --- [ocp-schedules-17,c9c178972bd32cca,0a4df2d51c2ba3f3] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:01:59.942 INFO 9 --- [ocp-schedules-22,c2ad63a06a890f9c,04d4e22b1cd944d0] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:59.943 INFO 9 --- [ocp-schedules-13,d1c69266e248ae5c,211dd490ed5febf9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:59.943 INFO 9 --- [ocp-schedules-17,c9c178972bd32cca,0a4df2d51c2ba3f3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:01:59.943 INFO 9 --- [ocp-schedules-17,c9c178972bd32cca,0a4df2d51c2ba3f3] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:01:59.945 INFO 9 --- [ocp-schedules-9,5bd67dac7e1f9bb2,ed51ff1826b1c43e] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:01:59.945 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:01:59.945 INFO 9 --- [ocp-schedules-14,8d99f5bd093e5439,d8da1a9cd8ecc7da] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:01:59.945 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:01:59.945 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:01:59.945 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:01:59.945 INFO 9 --- [ocp-schedules-29,16e6c9b005d687af,e8b90b1873bc4511] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:01:59.945 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:01:59.945 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:01:59.945 INFO 9 --- [host-check-agent-status1,16e6c9b005d687af,0565e0aba83eb2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:01:59.945 INFO 9 --- [host-check-clockdiff1,8d99f5bd093e5439,50eeea512ef3e8c5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:01:59.945 INFO 9 --- [host-check-clockdiff2,8d99f5bd093e5439,fc82755087454168] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:01:59.945 INFO 9 --- [host-check-agent-status2,16e6c9b005d687af,f126ee5ba67b385d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:01:59.945 INFO 9 --- [host-check-agent-status3,16e6c9b005d687af,5deafb11a287fdf5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:01:59.945 INFO 9 --- [host-check-clockdiff3,8d99f5bd093e5439,0d0e99ae8eef9724] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:01:59.945 INFO 9 --- [host-check-agent-status4,16e6c9b005d687af,d2abf886c93f7b0c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:01:59.946 INFO 9 --- [host-check-clockdiff4,8d99f5bd093e5439,48fbfa540893b8bf] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:01:59.946 INFO 9 --- [host-check-agent-status5,16e6c9b005d687af,b10274d44b191c5b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:01:59.946 INFO 9 --- [host-check-clockdiff5,8d99f5bd093e5439,6d92714daf8a8fe9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:01:59.946 INFO 9 --- [host-check-agent-status6,16e6c9b005d687af,46e1e5dddc49a4cf] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:01:59.946 INFO 9 --- [host-check-clockdiff6,8d99f5bd093e5439,888291844e756747] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:01:59.950 INFO 9 --- [ocp-schedules-23,14f8e940d9fcc760,23535088b6f45216] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:01:59.952 INFO 9 --- [host-check-clockdiff1,8d99f5bd093e5439,50eeea512ef3e8c5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002519 -1 -1 , error= 2025-09-16 14:01:59.952 INFO 9 --- [host-check-clockdiff2,8d99f5bd093e5439,fc82755087454168] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002519 -2 -2 , error= 2025-09-16 14:01:59.953 INFO 9 --- [host-check-clockdiff6,8d99f5bd093e5439,888291844e756747] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002519 -1 -1 , error= 2025-09-16 14:01:59.953 INFO 9 --- [host-check-clockdiff4,8d99f5bd093e5439,48fbfa540893b8bf] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002519 -1 -1 , error= 2025-09-16 14:01:59.956 INFO 9 --- [host-check-clockdiff3,8d99f5bd093e5439,0d0e99ae8eef9724] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002519 -2 -2 , error= 2025-09-16 14:01:59.957 INFO 9 --- [host-check-agent-status6,16e6c9b005d687af,46e1e5dddc49a4cf] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:59.957 INFO 9 --- [host-check-agent-status4,16e6c9b005d687af,d2abf886c93f7b0c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:01:59.957 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:59.957 INFO 9 --- [host-check-agent-status5,16e6c9b005d687af,b10274d44b191c5b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:01:59.957 INFO 9 --- [host-check-agent-status1,16e6c9b005d687af,0565e0aba83eb2c5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:01:59.957 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:01:59.957 INFO 9 --- [host-check-agent-status3,16e6c9b005d687af,5deafb11a287fdf5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:01:59.957 INFO 9 --- [host-check-agent-status2,16e6c9b005d687af,f126ee5ba67b385d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:01:59.957 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:01:59.957 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:01:59.958 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:01:59.958 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:01:59.958 INFO 9 --- [host-check-clockdiff5,8d99f5bd093e5439,6d92714daf8a8fe9] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002519 -1 -1 , error= 2025-09-16 14:01:59.959 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:01:59.959 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:01:59.959 INFO 9 --- [host-check-agent-status3,16e6c9b005d687af,5deafb11a287fdf5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:01:59.959 INFO 9 --- [host-check-agent-status2,16e6c9b005d687af,f126ee5ba67b385d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:01:59.959 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:01:59.959 INFO 9 --- [host-check-agent-status5,16e6c9b005d687af,b10274d44b191c5b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:01:59.959 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:01:59.959 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:59.959 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:01:59.959 INFO 9 --- [host-check-agent-status1,16e6c9b005d687af,0565e0aba83eb2c5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:01:59.959 INFO 9 --- [host-check-agent-status6,16e6c9b005d687af,46e1e5dddc49a4cf] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:01:59.959 INFO 9 --- [host-check-agent-status4,16e6c9b005d687af,d2abf886c93f7b0c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:01:59.973 INFO 9 --- [host-check-agent-status2,16e6c9b005d687af,f126ee5ba67b385d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:01:59.973 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:01:59.973 INFO 9 --- [host-check-agent-status6,16e6c9b005d687af,46e1e5dddc49a4cf] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:01:59.974 INFO 9 --- [host-check-agent-status3,16e6c9b005d687af,5deafb11a287fdf5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:01:59.974 INFO 9 --- [host-check-agent-status5,16e6c9b005d687af,b10274d44b191c5b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:01:59.974 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:01:59.974 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:01:59.974 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:01:59.975 INFO 9 --- [host-check-agent-status1,16e6c9b005d687af,0565e0aba83eb2c5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:01:59.975 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:01:59.975 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:01:59.975 INFO 9 --- [host-check-agent-status4,16e6c9b005d687af,d2abf886c93f7b0c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:01:59.976 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:01:59.975087691+08:00 2025-09-16 14:01:59.976 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:01:59.975143595+08:00 2025-09-16 14:01:59.976 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:01:59.975844908+08:00 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:01:59.975818295+08:00 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:01:59.976+08:00 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:01:59.976+08:00 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:01:59.977+08:00 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:01:59.977+08:00 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:01:59.976291806+08:00 2025-09-16 14:01:59.977 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:01:59.976224558+08:00 2025-09-16 14:01:59.977 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:01:59.977+08:00 2025-09-16 14:01:59.978 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:01:59.977+08:00 2025-09-16 14:01:59.978 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:01:59.978 INFO 9 --- [host-check-agent-status2,16e6c9b005d687af,f126ee5ba67b385d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:01:59.978 INFO 9 --- [host-check-agent-status2,16e6c9b005d687af,f126ee5ba67b385d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:01:59.978 INFO 9 --- [host-check-agent-status2,16e6c9b005d687af,f126ee5ba67b385d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status6,16e6c9b005d687af,46e1e5dddc49a4cf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status6,16e6c9b005d687af,46e1e5dddc49a4cf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status6,16e6c9b005d687af,46e1e5dddc49a4cf] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status3,16e6c9b005d687af,5deafb11a287fdf5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status3,16e6c9b005d687af,5deafb11a287fdf5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status3,16e6c9b005d687af,5deafb11a287fdf5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status5,16e6c9b005d687af,b10274d44b191c5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status5,16e6c9b005d687af,b10274d44b191c5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:01:59.979 INFO 9 --- [host-check-agent-status5,16e6c9b005d687af,b10274d44b191c5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:01:59.980 INFO 9 --- [host-check-agent-status1,16e6c9b005d687af,0565e0aba83eb2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:01:59.980 INFO 9 --- [host-check-agent-status1,16e6c9b005d687af,0565e0aba83eb2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:01:59.980 INFO 9 --- [host-check-agent-status1,16e6c9b005d687af,0565e0aba83eb2c5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:01:59.980 INFO 9 --- [host-check-agent-status4,16e6c9b005d687af,d2abf886c93f7b0c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:01:59.980 INFO 9 --- [host-check-agent-status4,16e6c9b005d687af,d2abf886c93f7b0c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:01:59.980 INFO 9 --- [host-check-agent-status4,16e6c9b005d687af,d2abf886c93f7b0c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:01:59.983 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:01:59.976+08:00 and status AVAILABLE 2025-09-16 14:01:59.983 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:01:59.983 INFO 9 --- [ocp-schedules-13,d1c69266e248ae5c,211dd490ed5febf9] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:01:59.984 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:01:59.976+08:00 and status AVAILABLE 2025-09-16 14:01:59.985 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:01:59.977+08:00 and status AVAILABLE 2025-09-16 14:01:59.986 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:01:59.986 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:01:59.977+08:00 and status AVAILABLE 2025-09-16 14:01:59.987 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:01:59.977+08:00 and status AVAILABLE 2025-09-16 14:01:59.987 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:01:59.988 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:01:59.989 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:01:59.977+08:00 and status AVAILABLE 2025-09-16 14:01:59.989 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:01:59.991 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:01:59.991 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:01:59.992 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:01:59.993 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:01:59.993 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:01:59.993 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:01:59.994 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:01:59.994 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:01:59.994 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:01:59.994 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:01:59.994 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:01:59.995 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:01:59.996 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:01:59.997 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:01:59.997 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:01:59.998 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:02:00.003772+08:00, lastProcessTime=2025-09-16T14:01:50.004516+08:00 2025-09-16 14:02:00.007 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:00.007 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:00.008 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:00.009 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:00.011 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:00.013 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:00.032 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:00.035 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:02:00.035 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:02:00.036 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:00.036 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:02:00.037 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:02:00.037 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:02:00.039 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:02:00.041 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:02:00.042 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:02:00.042 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:02:00.043 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:02:00.044 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:02:00.045 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:02:00.047 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:02:00.059 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:00.059 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:00.060 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:00.061 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:00.061 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:00.062 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:00.071 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:00.073 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:02:00.079 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:00.081 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:02:00.082 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:00.087 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:02:00.087 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:02:00.089 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:02:00.090 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:02:00.092 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:02:00.092 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:02:00.093 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:02:00.094 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:02:00.095 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:02:00.096 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:02:00.099 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:02:00.099 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:02:00.100 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.100 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:00.105 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:00.107 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:00.109 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:00.109 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:00.111 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:00.112 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:00.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:00.127 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:02:00.003772+08:00 2025-09-16 14:02:00.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.132 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:02:00.132 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:00.135 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:02:00.136 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:02:00.137 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:02:00.138 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:02:00.139 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:02:00.139 INFO 9 --- [host-check-host-status1,5bd67dac7e1f9bb2,531913b9b4640129] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:02:00.142 INFO 9 --- [host-check-host-status6,5bd67dac7e1f9bb2,41e7f5740ca907a5] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:02:00.143 INFO 9 --- [host-check-host-status5,5bd67dac7e1f9bb2,a2e4862e6a37dcb3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:02:00.144 INFO 9 --- [host-check-host-status4,5bd67dac7e1f9bb2,69d0ffac00e998cb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:02:00.145 INFO 9 --- [host-check-host-status3,5bd67dac7e1f9bb2,6b13d12d81efa92c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:02:00.145 INFO 9 --- [host-check-host-status2,5bd67dac7e1f9bb2,aa866cd7c7c73031] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:02:00.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.148 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:00.161 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.161 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:00.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.177 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:00.189 INFO 9 --- [ocp-async-8,2a2af845b7bf1545,2f47d30d12a39c79] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:02:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.190 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.206 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:00.219 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.219 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:00.234 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:00.248 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:00.249 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:00.250 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:00.255 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:02:00.258 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:02:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:00.262 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:00.275 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:02:00.343 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:02:00.357 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:00.361 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:00.361 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:02:00.376 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:02:00.376 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:02:00.376 INFO 9 --- [ocp-schedules-22,c2ad63a06a890f9c,04d4e22b1cd944d0] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:02:00.626 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:00.626 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:00.819 WARN 9 --- [ocp-async-9,4049097b994ffa69,25da08b5aee83b1e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:00.819 INFO 9 --- [ocp-async-4,d4c1d20174f017c0,5f2ec2a622ec4729] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:00.876 INFO 9 --- [ocp-schedules-28,6d330aad1a24ec59,240188da15540a1f] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:02:01.005 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,38d5d11fb8737a58,dc3a4531a1cb9352] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=10.232.140.0, traceId=38d5d11fb8737a58, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2025-09-16 14:02:01.005 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,38d5d11fb8737a58,dc3a4531a1cb9352] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=10.232.140.0, traceId=38d5d11fb8737a58, duration=2 ms] 2025-09-16 14:02:01.006 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,2f6ec26c67767a16,f7a6ab77ad6b18cf] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/sensitiveDataKey?null, client=10.232.140.0, traceId=2f6ec26c67767a16, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getSensitiveDataPublicKey(), args=] 2025-09-16 14:02:01.006 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,2f6ec26c67767a16,f7a6ab77ad6b18cf] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/sensitiveDataKey client=10.232.140.0, traceId=2f6ec26c67767a16, duration=2 ms] 2025-09-16 14:02:01.006 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,216fd24ef135fee5,e87b3fe1ebfedfef] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=10.232.140.0, traceId=216fd24ef135fee5, method=OcpBuildInfo com.oceanbase.ocp.server.common.controller.InfoController.info(), args=] 2025-09-16 14:02:01.006 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,216fd24ef135fee5,e87b3fe1ebfedfef] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=10.232.140.0, traceId=216fd24ef135fee5, duration=2 ms] 2025-09-16 14:02:01.109 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.232.140.0, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2025-09-16 14:02:01.109 WARN 9 --- [http-nio-0.0.0.0-8080-exec-8,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/maz/state, method=10.232.140.0, client=GET, traceId=] 2025-09-16 14:02:01.109 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.232.140.0, traceId=, duration=0 ms] 2025-09-16 14:02:01.636 INFO 9 --- [prometheus-minute-schedule-1,0a01061c1946f391,06a7d070e4206686] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:01.639 INFO 9 --- [prometheus-minute-schedule-1,0a01061c1946f391,06a7d070e4206686] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:02.505 INFO 9 --- [ocp-schedules-12,2a3b4022a53e0307,2ea4b8bc87ce277c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:02:02.527 WARN 9 --- [scanner-1389264-1,2a3b4022a53e0307,cb5d62c2f34415d4] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:02:02.539 INFO 9 --- [alarm-detect-7,2a3b4022a53e0307,94a54d4650f90672] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:02:02.540 INFO 9 --- [alarm-detect-20,2a3b4022a53e0307,f57f75b6cbf0ac6e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:02:02.540 INFO 9 --- [alarm-detect-8,2a3b4022a53e0307,1405203e366b98d1] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:02:02.553 INFO 9 --- [alarm-detect-7,2a3b4022a53e0307,d9b16c4a65f74be4] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:02:02.819 WARN 9 --- [ocp-async-3,61690711d7eee7fc,d2f255b4056920f2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:02.819 INFO 9 --- [ocp-async-10,318d4783d51b1dc1,0de343611038d67c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:03.626 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:03.627 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:03.996 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,47d51d5cda801dde,1f2285d33befec57] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/iam/actionGroups?null, client=10.232.140.0, traceId=47d51d5cda801dde, method=IterableResponse com.oceanbase.ocp.server.common.controller.IamController.listActionGroups(), args=] 2025-09-16 14:02:04.001 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,47d51d5cda801dde,1f2285d33befec57] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/actionGroups client=10.232.140.0, traceId=47d51d5cda801dde, duration=7 ms] 2025-09-16 14:02:04.636 INFO 9 --- [prometheus-minute-schedule-1,33ba573a23d72cb4,cc2a03db9880322d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:04.639 INFO 9 --- [prometheus-minute-schedule-1,33ba573a23d72cb4,cc2a03db9880322d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:04.819 INFO 9 --- [ocp-async-6,00817b5168c66cc5,de5e9fee43c2656f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:04.819 WARN 9 --- [ocp-async-5,47b5ce5f1028199c,2e474843ef38882c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:04.923 INFO 9 --- [ocp-schedules-22,4ad1cc5fd6991f59,f5180fffdc3b1f23] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:02:06.627 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:06.627 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:06.819 WARN 9 --- [ocp-async-9,ed553f39ddc95d9c,00b7d1bbafbecbd3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:06.819 INFO 9 --- [ocp-async-7,b31e1ac0d2782439,4b2dd4d52beee544] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:07.636 INFO 9 --- [prometheus-minute-schedule-1,b094f9859ca83ef6,caa8241276e8ec96] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:07.639 INFO 9 --- [prometheus-minute-schedule-1,b094f9859ca83ef6,caa8241276e8ec96] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:08.819 WARN 9 --- [ocp-async-3,3d8a1c2167961ae7,d30373fc2e790e41] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:08.819 INFO 9 --- [ocp-async-4,2422401ec7b04e0c,a75591405217698f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:09.371 INFO 9 --- [ocp-schedules-4,0901b0c74f4ac91d,1a24340de429ba7d] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:02:09.373 INFO 9 --- [ocp-schedules-4,0901b0c74f4ac91d,1a24340de429ba7d] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:02:09.627 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:09.628 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:10.002 INFO 9 --- [ocp-schedules-27,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2025-09-16 14:02:10.002 INFO 9 --- [ocp-schedules-22,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2025-09-16 14:02:10.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:02:10.003001+08:00, lastProcessTime=2025-09-16T14:02:00.003772+08:00 2025-09-16 14:02:10.109 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:02:10.003001+08:00 2025-09-16 14:02:10.189 INFO 9 --- [ocp-async-6,56969f01fc91aefc,081c8d395ce79411] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:02:10.298 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 14:02:10.636 INFO 9 --- [prometheus-minute-schedule-1,37aaad2cf27c5a95,beb03bab9432de34] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:10.639 INFO 9 --- [prometheus-minute-schedule-1,37aaad2cf27c5a95,beb03bab9432de34] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:10.819 INFO 9 --- [ocp-async-5,88b00d47984c7e58,4b243e77e75b5da7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:10.819 WARN 9 --- [ocp-async-2,1eb55f329d566f0c,92cc5f9328e68f17] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:11.766 INFO 9 --- [metric-archive-async-5,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002460, nodeCount=460, affectRows=460 2025-09-16 14:02:12.555 INFO 9 --- [ocp-schedules-18,79aa0263a71cc87f,e2608b646d364a52] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:02:12.561 WARN 9 --- [scanner-1390308-1,79aa0263a71cc87f,41f6e411fbdcd3cf] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:02:12.628 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:12.628 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:12.819 WARN 9 --- [ocp-async-9,959b03a77b97c76f,d593488dc9275290] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:12.820 INFO 9 --- [ocp-async-8,78da62e0ac27367c,fb2df99b5cd77699] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:13.636 INFO 9 --- [prometheus-minute-schedule-1,26a5d13fa7cdc7c7,1fd35d0dc0083e05] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:13.639 INFO 9 --- [prometheus-minute-schedule-1,26a5d13fa7cdc7c7,1fd35d0dc0083e05] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:14.422 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002460, nodeCount=1000, affectRows=1000 2025-09-16 14:02:14.424 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002460, nodeCount=1000, validCount=996 2025-09-16 14:02:14.450 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002460, nodeCount=1000, affectRows=1000 2025-09-16 14:02:14.452 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002460, nodeCount=1000, validCount=998 2025-09-16 14:02:14.463 ERROR 9 --- [metric-archive-second-1,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952595427328-1758002400' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952595427328-1758002400' for key 'PRIMARY' 2025-09-16 14:02:14.806 INFO 9 --- [ocp-schedules-15,421f70c04371754b,f1c22165d044d56c] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:02:14.810 INFO 9 --- [ocp-schedules-15,421f70c04371754b,f1c22165d044d56c] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:02:14.810 INFO 9 --- [ocp-schedules-15,421f70c04371754b,f1c22165d044d56c] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:02:14.820 WARN 9 --- [ocp-async-3,1c65249587c2e11d,83481edb57f4cc9e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:14.820 INFO 9 --- [ocp-async-1,8f45a070d2cb2009,74200e7c599f0408] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:14.926 INFO 9 --- [ocp-schedules-8,a09a85e7949bcfd8,de687af30a39a3cf] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:02:15.207 ERROR 9 --- [metric-archive-second-2,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697862) Duplicate entry '824147022819770368-1758002400' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697862) Duplicate entry '824147022819770368-1758002400' for key 'PRIMARY' 2025-09-16 14:02:15.628 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:15.629 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:15.871 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002460, nodeCount=1000, affectRows=1000 2025-09-16 14:02:15.873 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002460, nodeCount=992, validCount=957 2025-09-16 14:02:16.397 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002460, nodeCount=853, affectRows=853 2025-09-16 14:02:16.399 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002460, nodeCount=852, validCount=839 2025-09-16 14:02:16.636 INFO 9 --- [prometheus-minute-schedule-1,b0d2fe6268084390,0026d3bc04e55284] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:16.639 INFO 9 --- [prometheus-minute-schedule-1,b0d2fe6268084390,0026d3bc04e55284] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:16.820 WARN 9 --- [ocp-async-10,088ff24fda7be80a,a0c5e2b8a052eb77] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:16.820 INFO 9 --- [ocp-async-6,cd7887ed0c0bfd17,1dc134e7969cee78] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:18.599 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,e650bd9b93b1dc0f,4d87852ba7e6e633] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=e650bd9b93b1dc0f, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 14:02:18.600 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,e650bd9b93b1dc0f,4d87852ba7e6e633] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=e650bd9b93b1dc0f, duration=1 ms] 2025-09-16 14:02:18.629 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:18.629 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:18.820 WARN 9 --- [ocp-async-6,2c124c01504c79d4,224b61eeaea6d5ea] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:18.820 INFO 9 --- [ocp-async-7,f00e1bcd8fabecc2,0483bfb62c92f9fc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:19.377 INFO 9 --- [ocp-schedules-22,529e57e0ff627b46,a73f231ef4172c49] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:02:19.379 INFO 9 --- [ocp-schedules-22,529e57e0ff627b46,a73f231ef4172c49] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:02:19.636 INFO 9 --- [prometheus-minute-schedule-1,cc5e7d610dd0148d,fffde4028d086246] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:19.639 INFO 9 --- [prometheus-minute-schedule-1,cc5e7d610dd0148d,fffde4028d086246] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:20.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:02:20.003491+08:00, lastProcessTime=2025-09-16T14:02:10.003001+08:00 2025-09-16 14:02:20.118 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:02:20.003491+08:00 2025-09-16 14:02:20.189 INFO 9 --- [ocp-async-1,26978284ba5441c1,fecda3f217c8571f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:02:20.204 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,6436b42814c00aff,da74a36f7ed1f5b7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/idcs?null, client=10.232.140.0, traceId=6436b42814c00aff, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listIdcs(Pageable,Boolean), args=Page request [number: 0, size 5000, sort: id: DESC],false,] 2025-09-16 14:02:20.205 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,d8b4140b5f812b3a,92a47a7f1fe71078] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=10.232.140.0, traceId=d8b4140b5f812b3a, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:02:20.207 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,6436b42814c00aff,da74a36f7ed1f5b7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/idcs client=10.232.140.0, traceId=6436b42814c00aff, duration=5 ms] 2025-09-16 14:02:20.207 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,d8b4140b5f812b3a,92a47a7f1fe71078] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=10.232.140.0, traceId=d8b4140b5f812b3a, duration=5 ms] 2025-09-16 14:02:20.636 INFO 9 --- [prometheus-cache-monitor1,a9df5e2f1c7db4b6,759ec3e318a705c9] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3811,"seriesIdKeySize":16771,"secondWriteQueue":0,"minuteWriteCacheSize":14398} 2025-09-16 14:02:20.636 INFO 9 --- [prometheus-cache-monitor1,a9df5e2f1c7db4b6,759ec3e318a705c9] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:02:20.820 WARN 9 --- [ocp-async-8,e27fe0b6a46044ac,af90506d37c76b7f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:20.820 INFO 9 --- [ocp-async-3,e66c4f0d034d8e45,6aaf8fa1b6257bbf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:21.630 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:21.630 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:22.582 INFO 9 --- [ocp-schedules-26,04ff4bb69af042bb,a2bf9ee0a058c990] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:02:22.587 WARN 9 --- [scanner-1390429-1,04ff4bb69af042bb,17a62da3ebf8bfa6] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:02:22.597 INFO 9 --- [alarm-detect-5,04ff4bb69af042bb,b88215a4a1fce345] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:02:22.599 INFO 9 --- [alarm-detect-16,04ff4bb69af042bb,29d7957a2e5ac882] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:02:22.599 INFO 9 --- [alarm-detect-8,04ff4bb69af042bb,7f7bf8f1c18a4015] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:02:22.611 INFO 9 --- [alarm-detect-1,04ff4bb69af042bb,ecc4a4be27f69e6e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:02:22.636 INFO 9 --- [prometheus-minute-schedule-1,394780a81fabb69f,336a16d884a09e0f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:22.639 INFO 9 --- [prometheus-minute-schedule-1,394780a81fabb69f,336a16d884a09e0f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:22.820 WARN 9 --- [ocp-async-3,0409ac1d0733362d,68c391ec29f0b4a8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:22.820 INFO 9 --- [ocp-async-2,ed1af5303b39bd5f,356dcf46047d16ae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:24.630 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:24.631 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:24.820 WARN 9 --- [ocp-async-2,30c2def81e65a184,a082be6c22f5b2cc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:24.820 INFO 9 --- [ocp-async-5,c554bce0b581f66f,e3b0489d1f61cc0f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:24.929 INFO 9 --- [ocp-schedules-2,6c79bf107d2dc61f,c446e092ed2c6932] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:02:25.636 INFO 9 --- [prometheus-minute-schedule-1,18375880e453fe24,ab4b2a26f635b721] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:25.639 INFO 9 --- [prometheus-minute-schedule-1,18375880e453fe24,ab4b2a26f635b721] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:26.704 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,261df72fc5e0c10e,0811581fe4c475e6] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/parameterInfo?null, client=10.232.140.0, traceId=261df72fc5e0c10e, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listObproxyParameterInfo(String,String), args=] 2025-09-16 14:02:26.705 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,78b7c1c26893ced3,26d98b58e45cd149] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters/parameterTemplates?version=4.3.5.0-3, client=10.232.140.0, traceId=78b7c1c26893ced3, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listObproxyParameterTemplates(String,Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:02:26.714 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,261df72fc5e0c10e,0811581fe4c475e6] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/parameterInfo client=10.232.140.0, traceId=261df72fc5e0c10e, duration=12 ms] 2025-09-16 14:02:26.736 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,78b7c1c26893ced3,26d98b58e45cd149] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters/parameterTemplates client=10.232.140.0, traceId=78b7c1c26893ced3, duration=34 ms] 2025-09-16 14:02:26.820 WARN 9 --- [ocp-async-5,a4af39a402ad02e2,a1a82e0e8221e8ae] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:26.820 INFO 9 --- [ocp-async-8,1948acbd8806de98,030c2fef0a14639d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:27.631 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:27.631 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:28.256 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,3897b347943b59a0,4277a128b5a51831] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters/parameterTemplates?verison=4.3.5.0-3, client=10.232.140.0, traceId=3897b347943b59a0, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listObproxyParameterTemplates(String,Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:02:28.256 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,3eef6e34baa6ea71,9624934f3cf1ef75] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters/parameterTemplates?version=4.3.5.0-3, client=10.232.140.0, traceId=3eef6e34baa6ea71, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listObproxyParameterTemplates(String,Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2025-09-16 14:02:28.272 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,3eef6e34baa6ea71,9624934f3cf1ef75] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters/parameterTemplates client=10.232.140.0, traceId=3eef6e34baa6ea71, duration=18 ms] 2025-09-16 14:02:28.272 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,3897b347943b59a0,4277a128b5a51831] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters/parameterTemplates client=10.232.140.0, traceId=3897b347943b59a0, duration=19 ms] 2025-09-16 14:02:28.343 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,1b9dbd1b936acfdb,7194ec5f5fc12970] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/parameterInfo?null, client=10.232.140.0, traceId=1b9dbd1b936acfdb, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listObproxyParameterInfo(String,String), args=] 2025-09-16 14:02:28.347 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,1b9dbd1b936acfdb,7194ec5f5fc12970] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/parameterInfo client=10.232.140.0, traceId=1b9dbd1b936acfdb, duration=6 ms] 2025-09-16 14:02:28.636 INFO 9 --- [prometheus-minute-schedule-1,69f26af06fc84679,e94a52c9788c8d1e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:28.639 INFO 9 --- [prometheus-minute-schedule-1,69f26af06fc84679,e94a52c9788c8d1e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:28.820 WARN 9 --- [ocp-async-8,09a2b746e5e1a353,f9cd09172b548bf2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:28.820 INFO 9 --- [ocp-async-3,fef3860fb20eb637,ef5d594f01ca28bc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:29.384 INFO 9 --- [ocp-schedules-14,e57e2be814de33f6,92cefb58fc6e9328] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:02:29.386 INFO 9 --- [ocp-schedules-14,e57e2be814de33f6,92cefb58fc6e9328] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:02:29.938 INFO 9 --- [ocp-schedules-22,6a8e7983979cc012,4c13240aae552e09] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:02:29.941 INFO 9 --- [ocp-schedules-22,ec8451ffb62d2b9b,907ec189c7849057] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:02:29.941 INFO 9 --- [ocp-schedules-20,35b91d6bd7ec9b25,2ec5b9a96ad764c5] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:02:29.942 INFO 9 --- [ocp-schedules-18,930d9d79a427b974,5c9e8179ff7dabd7] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:02:29.943 INFO 9 --- [ocp-schedules-22,ec8451ffb62d2b9b,907ec189c7849057] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:29.943 INFO 9 --- [ocp-schedules-20,35b91d6bd7ec9b25,2ec5b9a96ad764c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:29.944 INFO 9 --- [ocp-schedules-18,930d9d79a427b974,5c9e8179ff7dabd7] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:29.944 INFO 9 --- [ocp-schedules-18,930d9d79a427b974,5c9e8179ff7dabd7] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:02:29.944 INFO 9 --- [ocp-schedules-10,43cb6aa7d93f3d00,550c62651a24dc12] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:02:29.945 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:02:29.945 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:02:29.945 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:02:29.945 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:02:29.945 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:02:29.945 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:02:29.945 INFO 9 --- [ocp-schedules-2,18e964bb23e6ef5d,057ce07f7349eecc] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:02:29.945 INFO 9 --- [ocp-schedules-25,17362d75cc2e7661,0524e72155209d82] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:02:29.945 INFO 9 --- [host-check-agent-status1,18e964bb23e6ef5d,a6125e3a75acc6ad] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:02:29.946 INFO 9 --- [host-check-clockdiff1,17362d75cc2e7661,5dacb0e19fbb1e86] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:02:29.946 INFO 9 --- [host-check-clockdiff2,17362d75cc2e7661,f229bedee7d61357] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:02:29.946 INFO 9 --- [host-check-clockdiff3,17362d75cc2e7661,fe4e08d394a783ed] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:02:29.946 INFO 9 --- [host-check-agent-status2,18e964bb23e6ef5d,0577292b312fa4dc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:02:29.946 INFO 9 --- [host-check-agent-status3,18e964bb23e6ef5d,9812dabaabd1e9e3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:02:29.946 INFO 9 --- [host-check-clockdiff4,17362d75cc2e7661,bf01809c568945f8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:02:29.946 INFO 9 --- [host-check-agent-status4,18e964bb23e6ef5d,fd73d8829898d77a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:02:29.946 INFO 9 --- [host-check-clockdiff5,17362d75cc2e7661,01d81287e6fdc5e3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:02:29.946 INFO 9 --- [host-check-agent-status5,18e964bb23e6ef5d,c0369c4c1cc6bdc5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:02:29.946 INFO 9 --- [host-check-clockdiff6,17362d75cc2e7661,cdfea935072ab2a1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:02:29.946 INFO 9 --- [host-check-agent-status6,18e964bb23e6ef5d,d041519cad0c3641] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:02:29.952 INFO 9 --- [ocp-schedules-13,da6ab93008099031,78eb47eade06635b] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:02:29.952 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:02:29.952 INFO 9 --- [host-check-clockdiff1,17362d75cc2e7661,5dacb0e19fbb1e86] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002549 -1 -1 , error= 2025-09-16 14:02:29.954 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:02:29.954 INFO 9 --- [host-check-clockdiff4,17362d75cc2e7661,bf01809c568945f8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002549 -1 -1 , error= 2025-09-16 14:02:29.954 INFO 9 --- [host-check-clockdiff5,17362d75cc2e7661,01d81287e6fdc5e3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002549 -1 -1 , error= 2025-09-16 14:02:29.955 INFO 9 --- [host-check-agent-status2,18e964bb23e6ef5d,0577292b312fa4dc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:02:29.955 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:29.955 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:29.955 INFO 9 --- [host-check-agent-status1,18e964bb23e6ef5d,a6125e3a75acc6ad] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:02:29.955 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:02:29.957 INFO 9 --- [host-check-agent-status3,18e964bb23e6ef5d,9812dabaabd1e9e3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:02:29.957 INFO 9 --- [host-check-agent-status5,18e964bb23e6ef5d,c0369c4c1cc6bdc5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:29.957 INFO 9 --- [host-check-agent-status4,18e964bb23e6ef5d,fd73d8829898d77a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:29.957 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:29.957 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:02:29.957 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:02:29.958 INFO 9 --- [host-check-clockdiff3,17362d75cc2e7661,fe4e08d394a783ed] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002549 -1 -1 , error= 2025-09-16 14:02:29.958 INFO 9 --- [host-check-clockdiff2,17362d75cc2e7661,f229bedee7d61357] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002549 -1 -1 , error= 2025-09-16 14:02:29.958 INFO 9 --- [host-check-agent-status2,18e964bb23e6ef5d,0577292b312fa4dc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:02:29.958 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:29.958 INFO 9 --- [host-check-agent-status6,18e964bb23e6ef5d,d041519cad0c3641] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:29.958 INFO 9 --- [host-check-agent-status5,18e964bb23e6ef5d,c0369c4c1cc6bdc5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:29.958 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:02:29.958 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:29.958 INFO 9 --- [host-check-agent-status1,18e964bb23e6ef5d,a6125e3a75acc6ad] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:02:29.958 INFO 9 --- [host-check-agent-status4,18e964bb23e6ef5d,fd73d8829898d77a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:29.958 INFO 9 --- [host-check-agent-status3,18e964bb23e6ef5d,9812dabaabd1e9e3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:02:29.959 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:29.959 INFO 9 --- [host-check-agent-status6,18e964bb23e6ef5d,d041519cad0c3641] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:29.962 INFO 9 --- [ocp-schedules-27,b8bf4fa6660ff498,ca576d78c9751cd9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 14:02:29.963 INFO 9 --- [ocp-schedules-11,f62b49fe474d400e,dbaca8f4ccde068b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 14:02:29.968 INFO 9 --- [ocp-schedules-27,b8bf4fa6660ff498,ca576d78c9751cd9] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 14:02:29.969 INFO 9 --- [ocp-schedules-11,f62b49fe474d400e,dbaca8f4ccde068b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 14:02:29.973 INFO 9 --- [host-check-agent-status2,18e964bb23e6ef5d,0577292b312fa4dc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:02:29.973 INFO 9 --- [host-check-agent-status3,18e964bb23e6ef5d,9812dabaabd1e9e3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:02:29.973 INFO 9 --- [host-check-agent-status1,18e964bb23e6ef5d,a6125e3a75acc6ad] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:02:29.973 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:02:29.973 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:02:29.973 INFO 9 --- [host-check-agent-status4,18e964bb23e6ef5d,fd73d8829898d77a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:02:29.973 INFO 9 --- [host-check-agent-status5,18e964bb23e6ef5d,c0369c4c1cc6bdc5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:02:29.973 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:02:29.974 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:02:29.974 INFO 9 --- [host-check-agent-status6,18e964bb23e6ef5d,d041519cad0c3641] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:02:29.975 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:02:29.975 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:02:29.974054738+08:00 2025-09-16 14:02:29.975 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:02:29.974036989+08:00 2025-09-16 14:02:29.975 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:02:29.974334331+08:00 2025-09-16 14:02:29.976 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:02:29.975+08:00 2025-09-16 14:02:29.976 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:02:29.975+08:00 2025-09-16 14:02:29.976 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:02:29.976 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:02:29.975+08:00 2025-09-16 14:02:29.976 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:02:29.975393716+08:00 2025-09-16 14:02:29.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:29.976 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:02:29.975575790+08:00 2025-09-16 14:02:29.977 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:02:29.976+08:00 2025-09-16 14:02:29.977 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:02:29.976+08:00 2025-09-16 14:02:29.977 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:29.977 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:02:29.975+08:00 and status AVAILABLE 2025-09-16 14:02:29.977 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:02:29.975+08:00 and status AVAILABLE 2025-09-16 14:02:29.977 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:02:29.975+08:00 and status AVAILABLE 2025-09-16 14:02:29.977 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:02:29.976220145+08:00 2025-09-16 14:02:29.977 INFO 9 --- [host-check-agent-status5,18e964bb23e6ef5d,c0369c4c1cc6bdc5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status5,18e964bb23e6ef5d,c0369c4c1cc6bdc5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status5,18e964bb23e6ef5d,c0369c4c1cc6bdc5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status2,18e964bb23e6ef5d,0577292b312fa4dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status4,18e964bb23e6ef5d,fd73d8829898d77a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status2,18e964bb23e6ef5d,0577292b312fa4dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status4,18e964bb23e6ef5d,fd73d8829898d77a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status2,18e964bb23e6ef5d,0577292b312fa4dc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status4,18e964bb23e6ef5d,fd73d8829898d77a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status3,18e964bb23e6ef5d,9812dabaabd1e9e3] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status3,18e964bb23e6ef5d,9812dabaabd1e9e3] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:02:29.978 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:02:29.977+08:00 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status3,18e964bb23e6ef5d,9812dabaabd1e9e3] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status1,18e964bb23e6ef5d,a6125e3a75acc6ad] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status1,18e964bb23e6ef5d,a6125e3a75acc6ad] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:02:29.978 INFO 9 --- [host-check-agent-status1,18e964bb23e6ef5d,a6125e3a75acc6ad] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:02:29.978 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:02:29.976+08:00 and status AVAILABLE 2025-09-16 14:02:29.978 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:02:29.976+08:00 and status AVAILABLE 2025-09-16 14:02:29.979 INFO 9 --- [host-check-agent-status6,18e964bb23e6ef5d,d041519cad0c3641] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:02:29.979 INFO 9 --- [host-check-agent-status6,18e964bb23e6ef5d,d041519cad0c3641] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:02:29.979 INFO 9 --- [host-check-agent-status6,18e964bb23e6ef5d,d041519cad0c3641] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:02:29.979 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:02:29.977+08:00 and status AVAILABLE 2025-09-16 14:02:29.980 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:02:29.980 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:02:29.981 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:02:29.981 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:02:29.982 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:02:29.982 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:02:29.982 INFO 9 --- [ocp-schedules-20,35b91d6bd7ec9b25,2ec5b9a96ad764c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:02:29.983 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:02:29.986 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:02:29.986 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:02:29.987 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:02:29.987 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:02:29.987 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:29.987 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:29.987 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:29.988 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:29.988 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:29.988 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:02:29.989 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:02:29.990 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:02:30.000 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:30.000 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:30.002 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:30.002 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:30.002 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:30.002 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:02:30.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:02:30.003632+08:00, lastProcessTime=2025-09-16T14:02:20.003491+08:00 2025-09-16 14:02:30.024 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:30.026 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:30.026 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:02:30.028 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:02:30.028 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:02:30.029 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:02:30.029 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:02:30.029 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:02:30.030 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:02:30.031 INFO 9 --- [ocp-schedules-6,6c835a11cc96b17c,544584b0f3c9e3ec] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15412,"minuteWriteQueue":0,"minuteReadCacheSize":7201,"secondWriteCacheSize":3811,"seriesIdKeySize":16771,"secondWriteQueue":0,"minuteWriteCacheSize":14398} 2025-09-16 14:02:30.032 INFO 9 --- [ocp-schedules-6,6c835a11cc96b17c,544584b0f3c9e3ec] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:02:30.034 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:02:30.034 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:02:30.036 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:02:30.036 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:02:30.036 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:02:30.036 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:02:30.047 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:30.047 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:30.047 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:30.049 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:30.049 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:30.049 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:02:30.072 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:30.073 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:02:30.074 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:02:30.075 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:02:30.075 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:02:30.076 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:02:30.077 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:02:30.078 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:02:30.078 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:30.080 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:02:30.081 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:02:30.081 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:30.081 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:02:30.082 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:02:30.083 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:02:30.083 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:02:30.084 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:02:30.093 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:30.095 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:30.095 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.095 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:30.095 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:30.095 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:30.095 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:02:30.101 INFO 9 --- [prometheus-second-schedule-1,6f88c2178193a73c,7c959fe61ba07c5d] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 14:02:30.112 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.112 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:30.122 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:02:30.122 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:02:30.123 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:02:30.123 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:02:30.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:30.126 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:02:30.128 INFO 9 --- [host-check-host-status5,43cb6aa7d93f3d00,ff51a7e77b1ec0f8] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:02:30.129 INFO 9 --- [host-check-host-status2,43cb6aa7d93f3d00,0f407bcbf9cded1d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:02:30.129 INFO 9 --- [host-check-host-status4,43cb6aa7d93f3d00,ef37a97809b98506] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:02:30.129 INFO 9 --- [host-check-host-status3,43cb6aa7d93f3d00,72672ca4be70fe7f] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:02:30.130 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:02:30.133 INFO 9 --- [host-check-host-status1,43cb6aa7d93f3d00,8e4314f2b76a5f6d] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:02:30.137 INFO 9 --- [host-check-host-status6,43cb6aa7d93f3d00,68ef2426820c07b3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:02:30.142 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.142 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:30.147 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:02:30.003632+08:00 2025-09-16 14:02:30.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.171 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:30.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:30.189 INFO 9 --- [ocp-async-4,3ce01a19d29fe946,edfb92300fcaa61b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:02:30.199 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.199 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:02:30.212 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.212 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:02:30.228 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:02:30.241 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:30.243 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:30.243 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:30.249 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:02:30.251 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:02:30.254 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:30.255 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:30.268 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:02:30.284 INFO 9 --- [ocp-schedules-21,077d8d66a1511ab6,deb71eb0a4416113] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 14:02:30.285 INFO 9 --- [ocp-schedules-21,077d8d66a1511ab6,deb71eb0a4416113] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:30.286 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 14:02:30.286 INFO 9 --- [ocp-schedules-21,077d8d66a1511ab6,deb71eb0a4416113] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:02:30.328 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:02:30.342 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:30.343 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:30.344 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:02:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:02:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:02:30.358 INFO 9 --- [ocp-schedules-22,ec8451ffb62d2b9b,907ec189c7849057] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:02:30.417 INFO 9 --- [ocp-schedules-1,419ba90e048bb259,8ba83c3f673bb90b] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 14:02:30.606 INFO 9 --- [ocp-schedules-13,718797b91f8170b8,dfe77d246fb40080] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 14:02:30.609 INFO 9 --- [ocp-schedules-13,718797b91f8170b8,dfe77d246fb40080] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 14:02:30.609 INFO 9 --- [ocp-schedules-13,718797b91f8170b8,dfe77d246fb40080] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 14:02:30.631 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:30.632 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:30.821 WARN 9 --- [ocp-async-9,9f78261ee0dabdf5,7fa4a87dd1d2363d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:30.821 INFO 9 --- [ocp-async-1,c76d6ae55c80678a,3e1fdbc44b35fc23] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:30.878 INFO 9 --- [ocp-schedules-19,fd6626be41046986,9f19070f64cc5b50] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:02:31.004 INFO 9 --- [ocp-schedules-14,c996a51198c008d9,0dc70b5dbbd5a603] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 14:02:31.004 INFO 9 --- [ocp-schedules-14,c996a51198c008d9,0dc70b5dbbd5a603] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 14:02:31.516 INFO 9 --- [ocp-schedules-4,85d403d9dde40da5,6bf0e4dbe69f71c8] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 14:02:31.516 INFO 9 --- [ocp-schedules-4,85d403d9dde40da5,6bf0e4dbe69f71c8] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002551 2025-09-16 14:02:31.518 INFO 9 --- [ocp-schedules-4,85d403d9dde40da5,6bf0e4dbe69f71c8] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 14:02:31.636 INFO 9 --- [prometheus-minute-schedule-1,ce3450545966e6df,3660f39bec686d4a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:31.639 INFO 9 --- [prometheus-minute-schedule-1,ce3450545966e6df,3660f39bec686d4a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:31.692 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2025-09-16 14:02:31.692 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2025-09-16 14:02:31.695 INFO 9 --- [ocp-schedules-22,6ee91a72b7df94d3,fa18cd3196132e51] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 14:02:31.695 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2025-09-16 14:02:31.695 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: binlogQueryCache 2025-09-16 14:02:31.695 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.c.cache.helper.BinlogQueryCache : Init binlog cache. 2025-09-16 14:02:31.701 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.c.cache.helper.BinlogQueryCache : Finish init binlog cache. 2025-09-16 14:02:31.701 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2025-09-16 14:02:31.701 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2025-09-16 14:02:31.709 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2025-09-16 14:02:31.709 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2025-09-16 14:02:31.709 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2025-09-16 14:02:31.712 INFO 9 --- [ocp-schedules-21,56399e17ebe3f697,271893fbb979167f] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2025-09-16 14:02:31.722 INFO 9 --- [ocp-schedules-18,c83c3ab0968fab1e,eac416ccced9f867] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 14:02:31.722 INFO 9 --- [ocp-schedules-18,c83c3ab0968fab1e,eac416ccced9f867] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824442618499219456 2025-09-16 14:02:31.725 INFO 9 --- [ocp-schedules-18,c83c3ab0968fab1e,eac416ccced9f867] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=2, maxSyncedRecordId=824445009273470976 2025-09-16 14:02:31.725 INFO 9 --- [ocp-schedules-18,c83c3ab0968fab1e,eac416ccced9f867] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 14:02:31.725 INFO 9 --- [ocp-schedules-18,c83c3ab0968fab1e,eac416ccced9f867] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 14:02:31.727 INFO 9 --- [ocp-schedules-18,c83c3ab0968fab1e,eac416ccced9f867] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 14:02:31.727 INFO 9 --- [ocp-schedules-18,c83c3ab0968fab1e,eac416ccced9f867] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 14:02:31.731 INFO 9 --- [host-check-clockdiff6,17362d75cc2e7661,cdfea935072ab2a1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002551 -2 -2 , error= 2025-09-16 14:02:31.754 INFO 9 --- [ocp-schedules-9,4323d9709b9af869,98a07f80f30be946] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 14:02:31.782 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,d37a4f8d27b79dc6,7cd28d51a8487685] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/compute/hosts/batchCheckHostDirectoryPermissions, client 10.232.140.0, traceId d37a4f8d27b79dc6] 2025-09-16 14:02:31.782 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,8004652f36ab5318,aff1cb35757a1c8b] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/compute/hosts/batchCheckPortOccupied, client 10.232.140.0, traceId 8004652f36ab5318] 2025-09-16 14:02:31.783 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,8004652f36ab5318,aff1cb35757a1c8b] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/compute/hosts/batchCheckPortOccupied?null, client=10.232.140.0, traceId=8004652f36ab5318, method=IterableResponse com.oceanbase.ocp.server.common.controller.ComputeController.batchCheckPortOccupied(BatchCheckPortOccupiedRequest), args=BatchCheckPortOccupiedRequest(hostIdList=[12, 11, 10], portList=[2883, 2884, 2885]),] 2025-09-16 14:02:31.783 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,d37a4f8d27b79dc6,7cd28d51a8487685] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/compute/hosts/batchCheckHostDirectoryPermissions?null, client=10.232.140.0, traceId=d37a4f8d27b79dc6, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ComputeController.batchCheckHostDirectoryPermissions(BatchCheckHostDirectoryRequest), args=BatchCheckHostDirectoryRequest(username=admin, hostIdList=[12, 11, 10], testDirectoryList=[HostDirectory(key=installPath, directory=/home/admin)], permissionList=[ACCESS_READ, ACCESS_EXECUTE], onlyExistedAncestor=false),] 2025-09-16 14:02:31.783 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,8004652f36ab5318,aff1cb35757a1c8b] c.o.o.c.host.service.HostServiceImpl : Batch check host ports occupied, request:BatchCheckPortOccupiedRequest(hostIdList=[12, 11, 10], portList=[2883, 2884, 2885]) 2025-09-16 14:02:31.789 INFO 9 --- [pool-72-thread-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:31.789 INFO 9 --- [pool-72-thread-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:31.789 INFO 9 --- [pool-72-thread-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:31.790 INFO 9 --- [pool-72-thread-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:31.790 INFO 9 --- [pool-72-thread-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:31.790 INFO 9 --- [pool-72-thread-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:31.792 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,d37a4f8d27b79dc6,7cd28d51a8487685] c.o.o.c.host.service.HostServiceImpl : validHostIdList=[12, 11, 10] 2025-09-16 14:02:31.798 INFO 9 --- [pool-73-thread-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:31.799 INFO 9 --- [pool-73-thread-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:31.799 INFO 9 --- [pool-73-thread-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:31.799 INFO 9 --- [pool-73-thread-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:31.800 INFO 9 --- [pool-73-thread-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:31.800 INFO 9 --- [pool-73-thread-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:31.804 INFO 9 --- [pool-72-thread-2,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/system/checkPortOccupied, request body:CheckPortOccupiedRequest(portList=[2883, 2884, 2885]), params:null 2025-09-16 14:02:31.804 INFO 9 --- [pool-72-thread-1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/system/checkPortOccupied, request body:CheckPortOccupiedRequest(portList=[2883, 2884, 2885]), params:null 2025-09-16 14:02:31.804 INFO 9 --- [pool-72-thread-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/system/checkPortOccupied, request body:CheckPortOccupiedRequest(portList=[2883, 2884, 2885]), params:null 2025-09-16 14:02:31.812 INFO 9 --- [pool-73-thread-1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/file/checkDirectoryPermission, request body:CheckDirectoryPermissionRequest(directory=/home/admin, user=admin, permission=ACCESS_READ, onlyExistingAncestor=false), params:null 2025-09-16 14:02:31.814 INFO 9 --- [pool-73-thread-2,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/file/checkDirectoryPermission, request body:CheckDirectoryPermissionRequest(directory=/home/admin, user=admin, permission=ACCESS_READ, onlyExistingAncestor=false), params:null 2025-09-16 14:02:31.814 INFO 9 --- [pool-73-thread-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/file/checkDirectoryPermission, request body:CheckDirectoryPermissionRequest(directory=/home/admin, user=admin, permission=ACCESS_READ, onlyExistingAncestor=false), params:null 2025-09-16 14:02:31.827 INFO 9 --- [pool-73-thread-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:31.828 INFO 9 --- [pool-73-thread-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:31.828 INFO 9 --- [pool-73-thread-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:31.829 INFO 9 --- [pool-73-thread-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:31.829 INFO 9 --- [pool-73-thread-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:31.830 INFO 9 --- [pool-73-thread-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:31.831 INFO 9 --- [ocp-schedules-13,222c46f96a5be7e7,157e228819aac873] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 14:02:31.832 INFO 9 --- [ocp-schedules-13,222c46f96a5be7e7,157e228819aac873] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:31.841 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,8004652f36ab5318,aff1cb35757a1c8b] c.o.o.c.host.service.HostServiceImpl : Success check host ports occupied, result:[CheckHostPortOccupiedResult(hostId=null, hostIpAddress=192.168.0.159, resultList=[CheckPortOccupiedResult.OccupiedCheckResult(port=2883, occupied=false), CheckPortOccupiedResult.OccupiedCheckResult(port=2884, occupied=false), CheckPortOccupiedResult.OccupiedCheckResult(port=2885, occupied=false)]), CheckHostPortOccupiedResult(hostId=null, hostIpAddress=192.168.0.111, resultList=[CheckPortOccupiedResult.OccupiedCheckResult(port=2883, occupied=false), CheckPortOccupiedResult.OccupiedCheckResult(port=2884, occupied=false), CheckPortOccupiedResult.OccupiedCheckResult(port=2885, occupied=false)]), CheckHostPortOccupiedResult(hostId=null, hostIpAddress=192.168.0.104, resultList=[CheckPortOccupiedResult.OccupiedCheckResult(port=2883, occupied=false), CheckPortOccupiedResult.OccupiedCheckResult(port=2884, occupied=false), CheckPortOccupiedResult.OccupiedCheckResult(port=2885, occupied=false)])] 2025-09-16 14:02:31.841 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,8004652f36ab5318,aff1cb35757a1c8b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/compute/hosts/batchCheckPortOccupied client=10.232.140.0, traceId=8004652f36ab5318, duration=61 ms] 2025-09-16 14:02:31.842 INFO 9 --- [pool-73-thread-1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/file/checkDirectoryPermission, request body:CheckDirectoryPermissionRequest(directory=/home/admin, user=admin, permission=ACCESS_EXECUTE, onlyExistingAncestor=false), params:null 2025-09-16 14:02:31.844 INFO 9 --- [pool-73-thread-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/file/checkDirectoryPermission, request body:CheckDirectoryPermissionRequest(directory=/home/admin, user=admin, permission=ACCESS_EXECUTE, onlyExistingAncestor=false), params:null 2025-09-16 14:02:31.847 INFO 9 --- [ocp-schedules-13,222c46f96a5be7e7,157e228819aac873] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 14:02:31.857 INFO 9 --- [pool-73-thread-2,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/file/checkDirectoryPermission, request body:CheckDirectoryPermissionRequest(directory=/home/admin, user=admin, permission=ACCESS_EXECUTE, onlyExistingAncestor=false), params:null 2025-09-16 14:02:31.869 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,d37a4f8d27b79dc6,7cd28d51a8487685] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/compute/hosts/batchCheckHostDirectoryPermissions client=10.232.140.0, traceId=d37a4f8d27b79dc6, duration=89 ms] 2025-09-16 14:02:32.613 INFO 9 --- [ocp-schedules-10,3bac6773bf98c478,851eed974841f756] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:02:32.618 WARN 9 --- [scanner-1390593-1,3bac6773bf98c478,f406d7cb2681d2fc] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:02:32.821 WARN 9 --- [ocp-async-4,270749fcff87d6be,75ccedce5e59ec01] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:32.821 INFO 9 --- [ocp-async-6,6a0113875746f3dc,b2799f93713f296a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:33.542 INFO 9 --- [ocp-schedules-18,2b91652a05303062,b4cb70c0fb594a00] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 14:02:33.628 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/obproxy/clusters, client 10.232.140.0, traceId c2edbdfa7eff49f2] 2025-09-16 14:02:33.629 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/obproxy/clusters?null, client=10.232.140.0, traceId=c2edbdfa7eff49f2, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObproxyController.createObproxyCluster(CreateObproxyClusterParam), args=CreateObproxyClusterParam(name=obproxy_zq, password=xxx proxyropassword=xxx address=192.168.0.159, port=2883, vpcName=null, vpcId=null, workMode=CONFIG_URL, installPath=/home/admin/obproxy, runPath=null, runUser=admin, obproxyInstallParam=InstallObproxyParam(hostIds=[12, 11, 10], sqlPort=2883, exporterPort=2884, rpcPort=2885, version=obproxy-ce-4.3.5.0-3.el7.aarch64.rpm), lbInstanceConfigParam=null, obLinks=[], startupParameters=[ObproxyParameterParam(name=automatic_match_work_thread, value=TRUE), ObproxyParameterParam(name=client_sock_option_flag_out, value=3), ObproxyParameterParam(name=client_tcp_keepcnt, value=2), ObproxyParameterParam(name=client_tcp_keepidle, value=5), ObproxyParameterParam(name=client_tcp_keepintvl, value=5), ObproxyParameterParam(name=client_tcp_user_timeout, value=0), ObproxyParameterParam(name=enable_compression_protocol, value=FALSE), ObproxyParameterParam(name=enable_index_route, value=TRUE), ObproxyParameterParam(name=enable_ob_protocol_v2, value=TRUE), ObproxyParameterParam(name=enable_prometheus, value=TRUE), ObproxyParameterParam(name=enable_reroute, value=TRUE), ObproxyParameterParam(name=log_dir_size_threshold, value=20GB), ObproxyParameterParam(name=proxy_mem_limited, value=10G), ObproxyParameterParam(name=server_tcp_keepcnt, value=2), ObproxyParameterParam(name=server_tcp_keepidle, value=5), ObproxyParameterParam(name=server_tcp_keepintvl, value=5), ObproxyParameterParam(name=server_tcp_user_timeout, value=0), ObproxyParameterParam(name=sock_option_flag_out, value=3), ObproxyParameterParam(name=work_thread_num, value=32)], parameters=[], clientToken=null),] 2025-09-16 14:02:33.632 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:33.633 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:33.660 INFO 9 --- [pool-74-thread-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:33.660 INFO 9 --- [pool-74-thread-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:33.660 INFO 9 --- [pool-74-thread-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:33.661 INFO 9 --- [pool-74-thread-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:33.661 INFO 9 --- [pool-74-thread-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:33.661 INFO 9 --- [pool-74-thread-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:33.675 INFO 9 --- [pool-74-thread-2,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/system/userExists, request body:CheckUserExistsRequest(name=admin), params:null 2025-09-16 14:02:33.675 INFO 9 --- [pool-74-thread-1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/system/userExists, request body:CheckUserExistsRequest(name=admin), params:null 2025-09-16 14:02:33.675 INFO 9 --- [pool-74-thread-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/system/userExists, request body:CheckUserExistsRequest(name=admin), params:null 2025-09-16 14:02:33.679 INFO 9 --- [pool-75-thread-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:33.680 INFO 9 --- [pool-75-thread-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:33.680 INFO 9 --- [pool-75-thread-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:33.680 INFO 9 --- [pool-75-thread-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:33.680 INFO 9 --- [pool-75-thread-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:33.680 INFO 9 --- [pool-75-thread-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:33.682 INFO 9 --- [ocp-schedules-30,58af3565bbe88ac5,7fa1457c6b31d317] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T14:02:33.682+08:00, clusters=[1] 2025-09-16 14:02:33.683 INFO 9 --- [ocp-schedules-30,58af3565bbe88ac5,7fa1457c6b31d317] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 14:02:33.694 INFO 9 --- [pool-75-thread-3,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/system/commandExists, request body:CheckCommandExistsRequest(name=nc), params:null 2025-09-16 14:02:33.694 INFO 9 --- [pool-75-thread-1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/system/commandExists, request body:CheckCommandExistsRequest(name=nc), params:null 2025-09-16 14:02:33.695 INFO 9 --- [pool-75-thread-2,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/system/commandExists, request body:CheckCommandExistsRequest(name=nc), params:null 2025-09-16 14:02:33.709 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key row_lock_compute_host_12 2025-09-16 14:02:33.722 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.h.m.HostServiceManagerImpl : Reserved host: service [OB_PROXY:obproxy_zq:4.3.5.0-3], host [12:192.168.0.159], status changed from [ONLINE] to [ONLINE] 2025-09-16 14:02:33.731 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key row_lock_compute_host_11 2025-09-16 14:02:33.734 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.h.m.HostServiceManagerImpl : Reserved host: service [OB_PROXY:obproxy_zq:4.3.5.0-3], host [11:192.168.0.111], status changed from [ONLINE] to [ONLINE] 2025-09-16 14:02:33.742 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key row_lock_compute_host_10 2025-09-16 14:02:33.744 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.h.m.HostServiceManagerImpl : Reserved host: service [OB_PROXY:obproxy_zq:4.3.5.0-3], host [10:192.168.0.104], status changed from [ONLINE] to [ONLINE] 2025-09-16 14:02:33.758 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.s.c.CredentialServiceImpl : Begin to create or replace credential:CreateCredentialParam(targetType=OB_PROXY, validate=false, name=a1adc333-92ab-4887-a819-3eca5fd4f261, description=null, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=4, tenantId=null, clusterName=obproxy_zq, tenantName=proxysys, username=root), sshCredentialProperty=null, agentCredentialProperty=null, keystoreCredentialProperty=null) 2025-09-16 14:02:33.770 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.s.c.CredentialServiceImpl : Success to create or replace credential:CreateCredentialParam(targetType=OB_PROXY, validate=false, name=a1adc333-92ab-4887-a819-3eca5fd4f261, description=null, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=4, tenantId=null, clusterName=obproxy_zq, tenantName=proxysys, username=root), sshCredentialProperty=null, agentCredentialProperty=null, keystoreCredentialProperty=null) 2025-09-16 14:02:33.800 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.s.o.OrganizationResourceManager : add resource for current organization,organizationId=10000000,resourceType=4, resourceId=4 2025-09-16 14:02:33.800 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Create obproxy cluster, nodeCount=33, taskCount=61 2025-09-16 14:02:33.801 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Create obproxy cluster', taskDefinitionId=-1, state=RUNNING, type=MANUAL, clusterId=null, tenantId=null, hostId=null, creator='admin', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false, obproxy_run_path=/home/admin/obproxy, service_name=obproxy_zq, install_path=/home/admin/obproxy, obproxy_parameter_version=1, obproxy_cluster_id=4, obproxy_cluster_name=obproxy_zq, obproxy_proxyro_password=xxx former_obproxy_cluster_status=LOCK, obproxy_need_delete_cluster=true, ocpagent_service_name=proxy_agent, package_version=4.3.5.0-3, operation_scope=Cluster, rpm_name=obproxy-ce-4.3.5.0-3.el7.aarch64.rpm, package_name=obproxy-ce, target_obproxy_cluster_status=UNLOCK}, listMap={commands_to_check=[nc], obproxy_server_ids=[10, 11, 12], process_keywords=[obproxy, obproxyd.sh], host_ids=[10, 12, 11]}}, createTime=null, startTime=2025-09-16T14:02:33.801+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Wait node, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.WaitNode, seriesId=57, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Start obproxyd process, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.internal.task.StartObproxydTask, seriesId=10, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Prepare create obproxy, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.internal.task.PrepareCreateObproxyTask, seriesId=38, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Wait node, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.WaitNode, seriesId=32, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Register obproxy exporter, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.internal.task.RegisterObproxyExporterTask, seriesId=34, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Sync obp 2025-09-16 14:02:33.856 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1408} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.864 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1409} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.864 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1355} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.865 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1374} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.865 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1369} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.866 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1395} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.866 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1382} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.867 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1384} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.868 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1386} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.868 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1367} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.869 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1378} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.869 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1413} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.870 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1371} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.871 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1362} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.871 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1399} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.872 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1392} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.872 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1404} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.873 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1379} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.874 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1398} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.874 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1364} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.875 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1358} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.875 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1354} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.876 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1380} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.877 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1400} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.877 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1407} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.878 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1370} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.878 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1394} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.879 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1396} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.880 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1405} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.880 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1372} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.881 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1390} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.881 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1391} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.882 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1393} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.883 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1366} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.883 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1412} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=12, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.884 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1375} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=10, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.884 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1383} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=11, svrIp='192.168.0.111', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.885 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1360} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.886 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1368} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='obproxy_zq', obproxyClusterId=4, obproxyServerId=11, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.886 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1363} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=10, svrIp='192.168.0.104', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.887 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1357} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.887 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=1411} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=12, svrIp='192.168.0.159', deleted=false, createTime=null, binlogServerId=null, binlogClusterName=null, binlogClusterId=null, tenantBinlogServiceId=null, binlogInstanceName=null} 2025-09-16 14:02:33.888 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.task.TaskTagService : Save task tags, taskId=827, taskName=Create obproxy cluster, argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false, obproxy_run_path=/home/admin/obproxy, service_name=obproxy_zq, install_path=/home/admin/obproxy, obproxy_parameter_version=1, obproxy_cluster_id=4, obproxy_cluster_name=obproxy_zq, obproxy_proxyro_password=xxx former_obproxy_cluster_status=LOCK, obproxy_need_delete_cluster=true, ocpagent_service_name=proxy_agent, package_version=4.3.5.0-3, operation_scope=Cluster, rpm_name=obproxy-ce-4.3.5.0-3.el7.aarch64.rpm, package_name=obproxy-ce, target_obproxy_cluster_status=UNLOCK}, listMap={commands_to_check=[nc], obproxy_server_ids=[10, 11, 12], process_keywords=[obproxy, obproxyd.sh], host_ids=[10, 12, 11]}} 2025-09-16 14:02:33.901 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.ocp.service.audit.AuditEventService : begin create audit event, param:CreateAuditEventParam(operationEvent=CREATE_OB_PROXY_CLUSTER, eventType=OB_PROXY_CLUSTER_MANAGEMENT, methodSignature=com.oceanbase.ocp.server.common.controller.ObproxyController.createObproxyCluster, resourceType=OB_PROXY_CLUSTER, resources=[CreateAuditEventParam.AuditResourceParam(resourceId=null, resourceName=obproxy_zq, parentResource=null)], operatorId=100, operatorName=admin, status=UNFINISHED, failedReason=null, taskId=827, eventInfo={"body":{"address":"192.168.0.159","installPath":"/home/admin/obproxy","name":"obproxy_zq","obLinks":[],"obproxyInstallParam":{"exporterPort":2884,"hostIds":[12,11,10],"rpcPort":2885,"sqlPort":2883,"version":"obproxy-ce-4.3.5.0-3.el7.aarch64.rpm"},"parameters":[],"password":"******","port":2883,"runUser":"admin","startupParameters":[{"name":"automatic_match_work_thread","value":"TRUE"},{"name":"client_sock_option_flag_out","value":"3"},{"name":"client_tcp_keepcnt","value":"2"},{"name":"client_tcp_keepidle","value":"5"},{"name":"client_tcp_keepintvl","value":"5"},{"name":"client_tcp_user_timeout","value":"0"},{"name":"enable_compression_protocol","value":"FALSE"},{"name":"enable_index_route","value":"TRUE"},{"name":"enable_ob_protocol_v2","value":"TRUE"},{"name":"enable_prometheus","value":"TRUE"},{"name":"enable_reroute","value":"TRUE"},{"name":"log_dir_size_threshold","value":"20GB"},{"name":"proxy_mem_limited","value":"10G"},{"name":"server_tcp_keepcnt","value":"2"},{"name":"server_tcp_keepidle","value":"5"},{"name":"server_tcp_keepintvl","value":"5"},{"name":"server_tcp_user_timeout","value":"0"},{"name":"sock_option_flag_out","value":"3"},{"name":"work_thread_num","value":"32"}],"workMode":"CONFIG_URL"}}, executionType=NEW, requestUrl=http://192.168.0.131:32863/api/v2/obproxy/clusters, clientIp=10.232.140.0, serverIp=10.233.116.22, startTime=2025-09-16T14:02:33.629+08:00, endTime=null, role=null, aliUid=null) 2025-09-16 14:02:33.917 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,c2edbdfa7eff49f2,e5540176eed725a4] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/obproxy/clusters client=10.232.140.0, traceId=c2edbdfa7eff49f2, duration=291 ms] 2025-09-16 14:02:34.017 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,49f8cc1f45ad8ae2,780f01238456cb50] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.232.140.0, traceId=49f8cc1f45ad8ae2, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2025-09-16 14:02:34.017 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,bdb6b2734fbc3c17,57694cfddd4e6cd0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=10.232.140.0, traceId=bdb6b2734fbc3c17, method=SuccessResponse com.oceanbase.ocp.server.common.controller.PropertyController.getSystemInfo(), args=] 2025-09-16 14:02:34.017 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,bdb6b2734fbc3c17,57694cfddd4e6cd0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=10.232.140.0, traceId=bdb6b2734fbc3c17, duration=3 ms] 2025-09-16 14:02:34.017 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,93172b97528cc3cf,9e0cfb3be481c3a5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/state-statistics?null, client=10.232.140.0, traceId=93172b97528cc3cf, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskStateSummary(TaskType), args=MANUAL,] 2025-09-16 14:02:34.017 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,0f45d18483db1044,5a18fa78e618254f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=0f45d18483db1044, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:34.017 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,8719e5383ed18c26,0dcaf2fd9c3d81ad] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=10.232.140.0, traceId=8719e5383ed18c26, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2025-09-16 14:02:34.018 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,93172b97528cc3cf,9e0cfb3be481c3a5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/state-statistics client=10.232.140.0, traceId=93172b97528cc3cf, duration=4 ms] 2025-09-16 14:02:34.020 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,49f8cc1f45ad8ae2,780f01238456cb50] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.232.140.0, traceId=49f8cc1f45ad8ae2, duration=6 ms] 2025-09-16 14:02:34.064 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,0f45d18483db1044,5a18fa78e618254f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=0f45d18483db1044, duration=50 ms] 2025-09-16 14:02:34.069 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,63de3304a6dce373,598624386fa464b0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/telemetry?null, client=10.232.140.0, traceId=63de3304a6dce373, method=SuccessResponse com.oceanbase.ocp.controller.TelemetryController.get(), args=] 2025-09-16 14:02:34.077 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,63de3304a6dce373,598624386fa464b0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/telemetry client=10.232.140.0, traceId=63de3304a6dce373, duration=9 ms] 2025-09-16 14:02:34.119 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.232.140.0, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2025-09-16 14:02:34.119 WARN 9 --- [http-nio-0.0.0.0-8080-exec-5,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, method=10.232.140.0, client=GET, traceId=] 2025-09-16 14:02:34.119 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.232.140.0, traceId=, duration=0 ms] 2025-09-16 14:02:34.132 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,8719e5383ed18c26,0dcaf2fd9c3d81ad] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.232.140.0, traceId=8719e5383ed18c26, duration=118 ms] 2025-09-16 14:02:34.253 INFO 9 --- [ocp-schedules-29,4dbf0c5efe445026,6f3ca534dbab0b4d] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 14:02:34.253 INFO 9 --- [ocp-schedules-29,4dbf0c5efe445026,6f3ca534dbab0b4d] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 14:02:34.255 INFO 9 --- [ocp-schedules-29,4dbf0c5efe445026,6f3ca534dbab0b4d] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 14:02:34.272 INFO 9 --- [ocp-schedules-29,4dbf0c5efe445026,6f3ca534dbab0b4d] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 14:02:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 14:02:34.636 INFO 9 --- [prometheus-minute-schedule-1,ef0fa5b95a754c56,51243814196ce752] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:34.639 INFO 9 --- [prometheus-minute-schedule-1,ef0fa5b95a754c56,51243814196ce752] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:34.656 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,36f88665cb89031c] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1381, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:34.812 INFO 9 --- [ocp-schedules-27,81c41993bbf0dcec,d066cfc2d8d26ac6] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:02:34.816 INFO 9 --- [ocp-schedules-27,81c41993bbf0dcec,d066cfc2d8d26ac6] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:02:34.816 INFO 9 --- [ocp-schedules-27,81c41993bbf0dcec,d066cfc2d8d26ac6] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:02:34.821 WARN 9 --- [ocp-async-10,cc38b0a10bd76e44,5658d2504a696633] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:34.821 INFO 9 --- [ocp-async-3,1ca5b1506155d555,e2574b671ba90722] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:34.933 INFO 9 --- [ocp-schedules-19,45744dffc7c6cb25,57aefa93ddd21a40] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:02:34.965 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,e84c1b4cfa646311,e166896892b06984] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.232.140.0, traceId=e84c1b4cfa646311, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2025-09-16 14:02:34.966 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,a93be02ba03fcd04,69effe7ba98652fc] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=10.232.140.0, traceId=a93be02ba03fcd04, method=SuccessResponse com.oceanbase.ocp.server.common.controller.PropertyController.getSystemInfo(), args=] 2025-09-16 14:02:34.966 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,a93be02ba03fcd04,69effe7ba98652fc] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=10.232.140.0, traceId=a93be02ba03fcd04, duration=2 ms] 2025-09-16 14:02:34.966 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,f43f7c7276eb4b88,6810a1e808293f46] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/state-statistics?null, client=10.232.140.0, traceId=f43f7c7276eb4b88, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskStateSummary(TaskType), args=MANUAL,] 2025-09-16 14:02:34.966 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,a323a5dc3f3f9b4e,f7c5edf5f381ea17] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=a323a5dc3f3f9b4e, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:34.967 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,cd75a3e163449b1a,19485e6eaefe698d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=10.232.140.0, traceId=cd75a3e163449b1a, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2025-09-16 14:02:34.967 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,f43f7c7276eb4b88,6810a1e808293f46] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/state-statistics client=10.232.140.0, traceId=f43f7c7276eb4b88, duration=3 ms] 2025-09-16 14:02:34.969 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,e84c1b4cfa646311,e166896892b06984] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.232.140.0, traceId=e84c1b4cfa646311, duration=6 ms] 2025-09-16 14:02:34.978 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.232.140.0, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2025-09-16 14:02:34.978 WARN 9 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, method=10.232.140.0, client=GET, traceId=] 2025-09-16 14:02:34.978 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.232.140.0, traceId=, duration=0 ms] 2025-09-16 14:02:34.981 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,a323a5dc3f3f9b4e,f7c5edf5f381ea17] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=a323a5dc3f3f9b4e, duration=17 ms] 2025-09-16 14:02:35.044 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,ce120ea06f09c86b,3e64c4fda8f5dbf3] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/telemetry?null, client=10.232.140.0, traceId=ce120ea06f09c86b, method=SuccessResponse com.oceanbase.ocp.controller.TelemetryController.get(), args=] 2025-09-16 14:02:35.053 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,ce120ea06f09c86b,3e64c4fda8f5dbf3] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/telemetry client=10.232.140.0, traceId=ce120ea06f09c86b, duration=11 ms] 2025-09-16 14:02:35.084 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,cd75a3e163449b1a,19485e6eaefe698d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.232.140.0, traceId=cd75a3e163449b1a, duration=120 ms] 2025-09-16 14:02:35.263 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,1e3f9591f1cd4cdb,9bdcf1ba2aa98528] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827/subtasks/1377/logSegments?taskInstanceId=827&subtaskInstanceId=1377, client=10.232.140.0, traceId=1e3f9591f1cd4cdb, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=827,1377,] 2025-09-16 14:02:35.271 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,1e3f9591f1cd4cdb,9bdcf1ba2aa98528] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827/subtasks/1377/logSegments client=10.232.140.0, traceId=1e3f9591f1cd4cdb, duration=11 ms] 2025-09-16 14:02:35.667 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,1b9316269624a58c] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1377, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:35.872 INFO 9 --- [ocp-schedules-14,0315f90ef10a7f3d,bb9f2a4a13f4a030] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T14:02:35.872+08:00, clusters=[1] 2025-09-16 14:02:35.876 INFO 9 --- [ocp-schedules-14,0315f90ef10a7f3d,bb9f2a4a13f4a030] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 14:02:36.148 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,33963010c13ccef2,8c6ad365400e8f4a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=33963010c13ccef2, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:36.163 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,33963010c13ccef2,8c6ad365400e8f4a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=33963010c13ccef2, duration=18 ms] 2025-09-16 14:02:36.288 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,5d6eefeb7435c669,2a09d8bbda6efa7a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827/subtasks/1377/logSegments?taskInstanceId=827&subtaskInstanceId=1377, client=10.232.140.0, traceId=5d6eefeb7435c669, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=827,1377,] 2025-09-16 14:02:36.299 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,5d6eefeb7435c669,2a09d8bbda6efa7a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827/subtasks/1377/logSegments client=10.232.140.0, traceId=5d6eefeb7435c669, duration=14 ms] 2025-09-16 14:02:36.633 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:36.633 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:36.677 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,002aae607e13077b] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1355, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:36.684 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,002aae607e13077b] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1391, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:36.691 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,002aae607e13077b] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1412, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:36.821 WARN 9 --- [ocp-async-7,2436d36538bc5977,b545b3605cee2060] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:36.821 INFO 9 --- [ocp-async-5,afddcf2abbe7c758,1c654691f28c43c7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:37.636 INFO 9 --- [prometheus-minute-schedule-1,12ba6ae58553a300,4a096fb12f18af46] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:37.639 INFO 9 --- [prometheus-minute-schedule-1,12ba6ae58553a300,4a096fb12f18af46] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:37.702 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,7e027959d878e1b4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1356, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:37.925 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,969ad7ab85d6b771,5b01207130792358] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=10.232.140.0, traceId=969ad7ab85d6b771, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2025-09-16 14:02:37.925 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,93ba4e00a73f35a2,2cbc7f65fa8cae02] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=10.232.140.0, traceId=93ba4e00a73f35a2, method=OcpBuildInfo com.oceanbase.ocp.server.common.controller.InfoController.info(), args=] 2025-09-16 14:02:37.925 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,969ad7ab85d6b771,5b01207130792358] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=10.232.140.0, traceId=969ad7ab85d6b771, duration=3 ms] 2025-09-16 14:02:37.925 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,93ba4e00a73f35a2,2cbc7f65fa8cae02] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=10.232.140.0, traceId=93ba4e00a73f35a2, duration=3 ms] 2025-09-16 14:02:37.925 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ef981fa6ac802782,f8e7fd0e5c4d24e5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/sensitiveDataKey?null, client=10.232.140.0, traceId=ef981fa6ac802782, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getSensitiveDataPublicKey(), args=] 2025-09-16 14:02:37.925 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,ef981fa6ac802782,f8e7fd0e5c4d24e5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/sensitiveDataKey client=10.232.140.0, traceId=ef981fa6ac802782, duration=3 ms] 2025-09-16 14:02:37.925 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,057033832ca1b532,76f1dcf95e8008b6] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=057033832ca1b532, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:37.935 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.232.140.0, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2025-09-16 14:02:37.935 WARN 9 --- [http-nio-0.0.0.0-8080-exec-6,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/maz/state, method=10.232.140.0, client=GET, traceId=] 2025-09-16 14:02:37.935 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.232.140.0, traceId=, duration=0 ms] 2025-09-16 14:02:37.941 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,057033832ca1b532,76f1dcf95e8008b6] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=057033832ca1b532, duration=19 ms] 2025-09-16 14:02:38.087 INFO 9 --- [ocp-schedules-5,245b8f71d9c5bab9,e3aa328ce455b1b7] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 14:02:38.089 INFO 9 --- [ocp-schedules-5,245b8f71d9c5bab9,e3aa328ce455b1b7] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:38.110 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:38.111 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 14:02:38.124 INFO 9 --- [ocp-schedules-5,245b8f71d9c5bab9,e3aa328ce455b1b7] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 14:02:38.713 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,a602ae5c28ac061d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1364, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:38.720 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,a602ae5c28ac061d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1396, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:38.726 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,a602ae5c28ac061d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1405, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:38.821 WARN 9 --- [ocp-async-1,b93f243e66572d69,3e3a17ea79d0368e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:38.821 INFO 9 --- [ocp-async-4,6cd18f0d072c8bed,ef4461129de84c13] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:39.391 INFO 9 --- [ocp-schedules-19,4a481e45a6967fc1,8f6598a25d27c1dd] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:02:39.393 INFO 9 --- [ocp-schedules-19,4a481e45a6967fc1,8f6598a25d27c1dd] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:02:39.633 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:39.634 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:39.737 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,fa4acd88bfbd0019] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1387, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:39.902 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,e031b50a9d3a3ce7,d77cc63754219ea3] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/iam/actionGroups?null, client=10.232.140.0, traceId=e031b50a9d3a3ce7, method=IterableResponse com.oceanbase.ocp.server.common.controller.IamController.listActionGroups(), args=] 2025-09-16 14:02:39.902 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,b940c1957f4901ad,7bff6ddf164a874d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=b940c1957f4901ad, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:39.904 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,e031b50a9d3a3ce7,d77cc63754219ea3] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/actionGroups client=10.232.140.0, traceId=e031b50a9d3a3ce7, duration=5 ms] 2025-09-16 14:02:39.918 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,b940c1957f4901ad,7bff6ddf164a874d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=b940c1957f4901ad, duration=19 ms] 2025-09-16 14:02:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:02:40.004591+08:00, lastProcessTime=2025-09-16T14:02:30.003632+08:00 2025-09-16 14:02:40.013 INFO 9 --- [ocp-schedules-11,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=3 2025-09-16 14:02:40.013 INFO 9 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=3 2025-09-16 14:02:40.113 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:02:40.004591+08:00 2025-09-16 14:02:40.190 INFO 9 --- [ocp-async-9,e92a14a66f39b734,81ff4f64468d44f1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:02:40.221 INFO 9 --- [ocp-schedules-4,a09a9530cfa9d181,16dbe82014e8726d] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 14:02:40.221 INFO 9 --- [ocp-schedules-4,a09a9530cfa9d181,16dbe82014e8726d] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 14:02:40.227 INFO 9 --- [ocp-schedules-29,6215a50c3c8edaf1,4f6c6673acdb7884] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:02:40.227 INFO 9 --- [ocp-schedules-29,6215a50c3c8edaf1,4f6c6673acdb7884] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 14:02:40.228 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 14:02:40.228 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 14:02:40.228 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 14:02:40.228 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 14:02:40.231 INFO 9 --- [ocp-schedules-29,6215a50c3c8edaf1,4f6c6673acdb7884] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:40.231 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:40.231 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:02:40.231 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:40.232 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:02:40.232 INFO 9 --- [ocp-schedules-29,6215a50c3c8edaf1,4f6c6673acdb7884] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:40.232 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:02:40.232 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:40.232 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:40.232 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:02:40.236 INFO 9 --- [Collect all tenants major compactions2,a09a9530cfa9d181,9b507b5a7f93ebfc] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:02:40.236 INFO 9 --- [Collect all tenants major compactions3,a09a9530cfa9d181,9324f4354c984a4c] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 14:02:40.236 INFO 9 --- [Collect all tenants major compactions1,a09a9530cfa9d181,134b938ea400cfec] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 14:02:40.247 INFO 9 --- [ocp-schedules-29,6215a50c3c8edaf1,4f6c6673acdb7884] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 14:02:40.247 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 14:02:40.247 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 14:02:40.247 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 14:02:40.248 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 14:02:40.248 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 14:02:40.252 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:02:40.252 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:02:40.257 INFO 9 --- [Collect all tenants major compactions2,a09a9530cfa9d181,9b507b5a7f93ebfc] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:40.258 INFO 9 --- [Collect all tenants major compactions2,a09a9530cfa9d181,9b507b5a7f93ebfc] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 14:02:40.258 INFO 9 --- [Collect all tenants major compactions1,a09a9530cfa9d181,134b938ea400cfec] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:40.259 INFO 9 --- [Collect all tenants major compactions3,a09a9530cfa9d181,9324f4354c984a4c] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:40.260 INFO 9 --- [Collect all tenants major compactions1,a09a9530cfa9d181,134b938ea400cfec] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 14:02:40.261 INFO 9 --- [Collect all tenants major compactions3,a09a9530cfa9d181,9324f4354c984a4c] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 14:02:40.265 INFO 9 --- [Collect all tenants major compactions1,a09a9530cfa9d181,134b938ea400cfec] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:02:40.265 INFO 9 --- [Collect all tenants major compactions3,a09a9530cfa9d181,9324f4354c984a4c] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:02:40.266 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 14:02:40.268 INFO 9 --- [Collect all tenants major compactions2,a09a9530cfa9d181,9b507b5a7f93ebfc] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:02:40.268 INFO 9 --- [ocp-schedules-29,6215a50c3c8edaf1,4f6c6673acdb7884] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 14:02:40.269 INFO 9 --- [ocp-schedules-4,a09a9530cfa9d181,16dbe82014e8726d] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 14:02:40.636 INFO 9 --- [prometheus-minute-schedule-1,3e753b8e6325229c,0bd718d597d0c701] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:40.639 INFO 9 --- [prometheus-minute-schedule-1,3e753b8e6325229c,0bd718d597d0c701] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:40.747 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,1b8971425cd18765] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1360, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:40.754 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,1b8971425cd18765] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1383, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:40.761 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,1b8971425cd18765] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1411, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:40.821 WARN 9 --- [ocp-async-10,ddaf12e348de314b,85776a81d872e3cf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:40.821 INFO 9 --- [ocp-async-3,491720b3d9ae5cbe,0a7830878b769374] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:40.897 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,aea3b548565b6579,5de58cee7fd97747] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/iam/actionGroups?null, client=10.232.140.0, traceId=aea3b548565b6579, method=IterableResponse com.oceanbase.ocp.server.common.controller.IamController.listActionGroups(), args=] 2025-09-16 14:02:40.899 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,aea3b548565b6579,5de58cee7fd97747] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/iam/actionGroups client=10.232.140.0, traceId=aea3b548565b6579, duration=4 ms] 2025-09-16 14:02:41.772 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,524a6bc873e98a77] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1385, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:41.900 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,6270cdbd3da2c3d8,4d1e7011421b8a4f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=6270cdbd3da2c3d8, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:41.915 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,6270cdbd3da2c3d8,4d1e7011421b8a4f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=6270cdbd3da2c3d8, duration=18 ms] 2025-09-16 14:02:42.634 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:42.635 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:42.640 INFO 9 --- [ocp-schedules-15,727a67985757f887,ffe067a4b9f51dff] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:02:42.645 WARN 9 --- [scanner-1390716-1,727a67985757f887,d1d18fd8041fc4e2] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:02:42.655 INFO 9 --- [alarm-detect-14,727a67985757f887,6cd67e3a0e389ab3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:02:42.657 INFO 9 --- [alarm-detect-17,727a67985757f887,98065c2242f36566] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:02:42.658 INFO 9 --- [alarm-detect-5,727a67985757f887,c3ae858de0969f15] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:02:42.669 INFO 9 --- [alarm-detect-8,727a67985757f887,917bede47c3243cb] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:02:42.780 INFO 9 --- [ocp-schedules-12,b8f939d258aeb3d7,9d021901b561c95e] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 14:02:42.780 INFO 9 --- [ocp-schedules-12,b8f939d258aeb3d7,9d021901b561c95e] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 14:02:42.782 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,3525b406097b6ff4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1374, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:42.789 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,3525b406097b6ff4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1380, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:42.796 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,3525b406097b6ff4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1413, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:42.818 INFO 9 --- [ocp-schedules-12,b8f939d258aeb3d7,9d021901b561c95e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:42.819 INFO 9 --- [ocp-schedules-12,b8f939d258aeb3d7,9d021901b561c95e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 14:02:42.821 WARN 9 --- [ocp-async-9,9a2fd8cad96243bf,9a6cc4ad2b38c248] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:42.821 INFO 9 --- [ocp-async-5,2f7f3b4343de8e66,2d15c1df623e7b92] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:43.636 INFO 9 --- [prometheus-minute-schedule-1,c9492f23e374931f,28cac9efd1795cb8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:43.640 INFO 9 --- [prometheus-minute-schedule-1,c9492f23e374931f,28cac9efd1795cb8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:43.903 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,b61119d3a3f88604,59e04d2d6d357b96] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=b61119d3a3f88604, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:43.919 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,b61119d3a3f88604,59e04d2d6d357b96] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=b61119d3a3f88604, duration=19 ms] 2025-09-16 14:02:44.821 WARN 9 --- [ocp-async-8,771474f992ab2984,336f69a83502a2a9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:44.821 INFO 9 --- [ocp-async-4,cb7ce7fdf2de078b,0593efc956c55650] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:44.936 INFO 9 --- [ocp-schedules-16,5f29d57e290ba377,b475ccac7722c7f2] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:02:45.635 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:45.636 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:45.936 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,d16636a746b02f4c,64dfca51242ee22a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=d16636a746b02f4c, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:45.952 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,d16636a746b02f4c,64dfca51242ee22a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=d16636a746b02f4c, duration=19 ms] 2025-09-16 14:02:46.636 INFO 9 --- [prometheus-minute-schedule-1,dc75ed2ea2b47696,19ac266886ff158d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:46.640 INFO 9 --- [prometheus-minute-schedule-1,dc75ed2ea2b47696,19ac266886ff158d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:46.821 WARN 9 --- [ocp-async-2,cae1c5d435a94e08,7b6c7d724dedb16a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:46.822 INFO 9 --- [ocp-async-10,d30a1f4a77e805b4,3726c3e5656a442e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:47.532 INFO 9 --- [ocp-schedules-7,190d580398fd9a9e,f38a4e380d581fbc] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 14:02:47.534 INFO 9 --- [ocp-schedules-7,190d580398fd9a9e,f38a4e380d581fbc] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:47.581 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:02:47.582 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.584 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:02:47.612 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.613 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:02:47.635 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.636 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:02:47.660 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.661 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:02:47.666 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.666 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:02:47.690 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.691 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:02:47.711 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.712 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:02:47.716 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.717 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:02:47.741 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.742 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:02:47.764 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.765 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:02:47.785 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.785 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 14:02:47.786 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.787 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:02:47.788 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.788 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:02:47.789 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.790 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 14:02:47.790 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.791 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:02:47.792 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.792 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:02:47.807 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.807 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 14:02:47.808 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.809 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:02:47.810 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.810 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:02:47.825 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 14:02:47.829 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 14:02:47.853 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:02:47.855 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:47.855 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 14:02:47.884 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:02:47.884 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 14:02:47.884 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:02:47.884 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 14:02:47.884 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:02:47.884 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 14:02:47.886 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 14:02:47.886 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:02:47.886 INFO 9 --- [ocp-schedules-7,190d580398fd9a9e,f38a4e380d581fbc] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 14:02:47.928 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,9f51f2aec46bf745,913f87b443be96d3] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=9f51f2aec46bf745, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:47.944 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,9f51f2aec46bf745,913f87b443be96d3] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=9f51f2aec46bf745, duration=19 ms] 2025-09-16 14:02:48.636 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:48.637 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:48.822 WARN 9 --- [ocp-async-3,f54ae1d82896a628,f1be0edaf0437302] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:48.822 INFO 9 --- [ocp-async-9,f9d50c206c93deb5,2fc31dc5fc0c16e1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 14:02:49,042 |-INFO in ReconfigureOnChangeTask(born:1758002509042) - Empty watch file list. Disabling 2025-09-16 14:02:49.086 INFO 9 --- [ocp-schedules-3,65e15ff2c47c7295,6add546e25e6a9d3] c.o.o.a.service.AlarmTargetServiceImpl : alarm targets changed, pre targets ,,,,,C_zhengqi-1-PRIMARY,C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85,C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY,C_zhengqi-1/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85,H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85,H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85, current targets ,,C_obproxy_zq-4,C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,C_zhengqi-1-PRIMARY,C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85,C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY,C_zhengqi-1/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85,H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85,H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:02:49.237 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.238 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:49.239 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.240 INFO 9 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:49.241 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 14:02:49.254 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 14:02:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 14:02:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 14:02:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 14:02:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 14:02:49.268 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 14:02:49.272 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.272 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.272 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.272 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.272 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.272 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:49.272 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:49.273 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:49.273 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:49.273 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:49.273 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:02:49.274 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:02:49.295 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T14:00:30, start=2025-09-16T13:57:30, end=2025-09-16T14:00:00, updates=81, granule=120000ms, delay=180000ms 2025-09-16 14:02:49.297 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T14:00:30, start=2025-09-16T13:57:30, end=2025-09-16T14:00:00, updates=96, granule=120000ms, delay=180000ms 2025-09-16 14:02:49.299 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T14:00:30, start=2025-09-16T13:57:30, end=2025-09-16T14:00:00, updates=118, granule=120000ms, delay=180000ms 2025-09-16 14:02:49.301 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:00:30, target=2025-09-16T14:00:00, granule=120000ms, delay=30000ms) 2025-09-16 14:02:49.301 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T14:00:30, start=2025-09-16T13:57:30, end=2025-09-16T14:00:00, updates=152, granule=120000ms, delay=180000ms 2025-09-16 14:02:49.301 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=0) - not enough cached interval (source=2025-09-16T14:00:00, target=2025-09-16T13:47:30, granule=600000ms, delay=750000ms) 2025-09-16 14:02:49.303 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:00:30, target=2025-09-16T14:00:00, granule=120000ms, delay=30000ms) 2025-09-16 14:02:49.303 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=0) - not enough cached interval (source=2025-09-16T14:00:00, target=2025-09-16T13:47:30, granule=600000ms, delay=750000ms) 2025-09-16 14:02:49.303 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:00:30, target=2025-09-16T14:00:00, granule=120000ms, delay=30000ms) 2025-09-16 14:02:49.303 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=0) - not enough cached interval (source=2025-09-16T14:00:00, target=2025-09-16T13:47:30, granule=600000ms, delay=750000ms) 2025-09-16 14:02:49.305 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:00:30, target=2025-09-16T14:00:00, granule=120000ms, delay=30000ms) 2025-09-16 14:02:49.305 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=0) - not enough cached interval (source=2025-09-16T14:00:00, target=2025-09-16T13:47:30, granule=600000ms, delay=750000ms) 2025-09-16 14:02:49.312 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T14:00:30, start=2025-09-16T13:57:30, end=2025-09-16T14:00:00, updates=282, granule=120000ms, delay=180000ms 2025-09-16 14:02:49.317 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:00:30, target=2025-09-16T14:00:00, granule=120000ms, delay=30000ms) 2025-09-16 14:02:49.317 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=0) - not enough cached interval (source=2025-09-16T14:00:00, target=2025-09-16T13:47:30, granule=600000ms, delay=750000ms) 2025-09-16 14:02:49.317 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=76ms, period=120000ms 2025-09-16 14:02:49.398 INFO 9 --- [ocp-schedules-29,721bc794fa3f999d,14eee5586f3f180f] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:02:49.400 INFO 9 --- [ocp-schedules-29,721bc794fa3f999d,14eee5586f3f180f] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:02:49.636 INFO 9 --- [prometheus-minute-schedule-1,be85dc6e59457db2,aa466cf8ef4d007f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:49.639 INFO 9 --- [prometheus-minute-schedule-1,be85dc6e59457db2,aa466cf8ef4d007f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:49.900 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,370420bbd05fc476,f315790cf1c5d997] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=370420bbd05fc476, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:49.917 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,370420bbd05fc476,f315790cf1c5d997] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=370420bbd05fc476, duration=19 ms] 2025-09-16 14:02:50.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:02:50.003822+08:00, lastProcessTime=2025-09-16T14:02:40.004591+08:00 2025-09-16 14:02:50.125 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:02:50.003822+08:00 2025-09-16 14:02:50.190 INFO 9 --- [ocp-async-2,d4ce86dc53e75e08,6712e85374a2c7f8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:02:50.822 WARN 9 --- [ocp-async-8,751a1072b6e6d441,4e71cfaf2c518af2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:50.822 INFO 9 --- [ocp-async-6,ee41dc289583f4aa,4e8880b9e27036eb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:51.637 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:51.638 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:51.899 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,1aad3ac71d67d4e6,0163a5cc2ff46927] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=1aad3ac71d67d4e6, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:51.915 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,1aad3ac71d67d4e6,0163a5cc2ff46927] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=1aad3ac71d67d4e6, duration=19 ms] 2025-09-16 14:02:52.636 INFO 9 --- [prometheus-minute-schedule-1,abfed63488cf96f2,dc9afe69b9bf2384] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:52.639 INFO 9 --- [prometheus-minute-schedule-1,abfed63488cf96f2,dc9afe69b9bf2384] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:52.673 INFO 9 --- [ocp-schedules-11,8580c3c8b2d2290b,ff03fdb47b529a65] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:02:52.678 WARN 9 --- [scanner-1390880-1,8580c3c8b2d2290b,0eb5fb66cd72476b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:02:52.822 WARN 9 --- [ocp-async-2,5b08584f616277dd,9873381026d2f497] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:52.822 INFO 9 --- [ocp-async-7,d3a5bd2f4fad77ff,48f3cbec42a4dc92] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:53.663 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,90681ecb5a7415b3,6e7070bece99e7f8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=90681ecb5a7415b3, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:53.679 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,90681ecb5a7415b3,6e7070bece99e7f8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=90681ecb5a7415b3, duration=20 ms] 2025-09-16 14:02:54.008 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,7474fb399e4c990f,36627f871ee2e52a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=10.232.140.0, traceId=7474fb399e4c990f, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2025-09-16 14:02:54.125 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,7474fb399e4c990f,36627f871ee2e52a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.232.140.0, traceId=7474fb399e4c990f, duration=120 ms] 2025-09-16 14:02:54.638 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:54.638 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:54.818 INFO 9 --- [ocp-schedules-25,c0c94bdd4e221bbe,249c3c27df9a72ec] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:02:54.822 WARN 9 --- [ocp-async-1,e54f38fe9e749f82,e43417b57bcf5797] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:54.822 INFO 9 --- [ocp-async-3,41f1c54e93b17e4f,690e1d1990a137ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:54.822 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,1f958cb4cc4eca5b,469d0f2f1f9b424f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=1f958cb4cc4eca5b, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:54.824 INFO 9 --- [ocp-schedules-25,c0c94bdd4e221bbe,249c3c27df9a72ec] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:02:54.824 INFO 9 --- [ocp-schedules-25,c0c94bdd4e221bbe,249c3c27df9a72ec] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:02:54.839 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,1f958cb4cc4eca5b,469d0f2f1f9b424f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=1f958cb4cc4eca5b, duration=20 ms] 2025-09-16 14:02:54.940 INFO 9 --- [ocp-schedules-19,0ca6c17af662dc2d,8466415d66e2b736] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:02:55.636 INFO 9 --- [prometheus-minute-schedule-1,336e781bcc16ec8d,9532ced3074af018] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:55.639 INFO 9 --- [prometheus-minute-schedule-1,336e781bcc16ec8d,9532ced3074af018] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:55.928 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,cb87167625a50bcc,0ecb92fa6d63b35b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=cb87167625a50bcc, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:55.944 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,cb87167625a50bcc,0ecb92fa6d63b35b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=cb87167625a50bcc, duration=19 ms] 2025-09-16 14:02:56.822 WARN 9 --- [ocp-async-5,e1df96e6c326c263,2ed9db13f5db828c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:56.822 INFO 9 --- [ocp-async-8,0b4e746be006d718,552705b6010693a2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:56.830 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,2d8c03dca4d83172] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1406, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:57.084 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,6f8437914f9c18b0,bf761be3ecd43057] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=6f8437914f9c18b0, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:57.100 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,6f8437914f9c18b0,bf761be3ecd43057] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=6f8437914f9c18b0, duration=18 ms] 2025-09-16 14:02:57.639 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:02:57.639 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:02:57.840 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,164f9403e932550f] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1366, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:57.847 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,164f9403e932550f] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1375, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:57.853 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,164f9403e932550f] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1398, operation:EXECUTE, state: RUNNING 2025-09-16 14:02:58.046 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,29932ba0760f83e8,7637ce3dd9a3a32b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=29932ba0760f83e8, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:02:58.046 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,29932ba0760f83e8,7637ce3dd9a3a32b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=29932ba0760f83e8, duration=1 ms] 2025-09-16 14:02:58.048 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,ac379684c3871f26,a16833dc3b515cf9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=ac379684c3871f26, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:02:58.048 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,ac379684c3871f26,a16833dc3b515cf9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=ac379684c3871f26, duration=1 ms] 2025-09-16 14:02:58.053 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,00a9c5550b1886dd,c197c8716d7d859b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=00a9c5550b1886dd, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:02:58.053 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,00a9c5550b1886dd,c197c8716d7d859b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=00a9c5550b1886dd, duration=0 ms] 2025-09-16 14:02:58.054 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,e5e880ca5ca6b70a,a33a66fae5fdefc4] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=e5e880ca5ca6b70a, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:02:58.055 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,e5e880ca5ca6b70a,a33a66fae5fdefc4] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=e5e880ca5ca6b70a, duration=1 ms] 2025-09-16 14:02:58.055 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,69130a8d02b958ef,4c481fb94a665346] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=69130a8d02b958ef, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:02:58.055 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,69130a8d02b958ef,4c481fb94a665346] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=69130a8d02b958ef, duration=0 ms] 2025-09-16 14:02:58.057 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,6acfce4a230f5480,9a42c241162a09aa] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=6acfce4a230f5480, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:02:58.057 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,6acfce4a230f5480,9a42c241162a09aa] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=6acfce4a230f5480, duration=1 ms] 2025-09-16 14:02:58.204 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,60cc31b81ae00e37,872a2af217df7085] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=60cc31b81ae00e37, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:58.221 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,60cc31b81ae00e37,872a2af217df7085] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=60cc31b81ae00e37, duration=19 ms] 2025-09-16 14:02:58.636 INFO 9 --- [prometheus-minute-schedule-1,3a785ab710c1050a,995bec0e5c7adac8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002580, interval=60 2025-09-16 14:02:58.639 INFO 9 --- [prometheus-minute-schedule-1,3a785ab710c1050a,995bec0e5c7adac8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:02:58.822 WARN 9 --- [ocp-async-6,16aed3683d79b641,f0e87696cca6813f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:02:58.822 INFO 9 --- [ocp-async-10,2b755c58ee896bba,fe740483535f7f69] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:02:59.312 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,1ffde121b8ada01f,82393f15604a6a4d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=1ffde121b8ada01f, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:02:59.329 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,1ffde121b8ada01f,82393f15604a6a4d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=1ffde121b8ada01f, duration=20 ms] 2025-09-16 14:02:59.405 INFO 9 --- [ocp-schedules-23,a1ed53c5340ac384,03f5e34b7f1dc936] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:02:59.407 INFO 9 --- [ocp-schedules-23,a1ed53c5340ac384,03f5e34b7f1dc936] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:02:59.938 INFO 9 --- [ocp-schedules-24,8abf0785ae9f8057,4a653a67a3193f18] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:02:59.941 INFO 9 --- [ocp-schedules-10,9604c2a9a0db9f37,ea9878d96ef2dfdd] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:02:59.941 INFO 9 --- [ocp-schedules-20,fc23ea917bd9ff0c,5c81808b9a567ad4] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:02:59.942 INFO 9 --- [ocp-schedules-11,839bdb155819fdba,46d36050f1bd5df9] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:02:59.942 INFO 9 --- [ocp-schedules-10,9604c2a9a0db9f37,ea9878d96ef2dfdd] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:59.942 INFO 9 --- [ocp-schedules-20,fc23ea917bd9ff0c,5c81808b9a567ad4] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:59.943 INFO 9 --- [ocp-schedules-11,839bdb155819fdba,46d36050f1bd5df9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:02:59.944 INFO 9 --- [ocp-schedules-11,839bdb155819fdba,46d36050f1bd5df9] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:02:59.944 INFO 9 --- [ocp-schedules-28,1b13fcc01d9d3d73,ff476bb8a0648001] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:02:59.945 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:02:59.945 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:02:59.945 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:02:59.945 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:02:59.945 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:02:59.945 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:02:59.945 INFO 9 --- [ocp-schedules-15,8a433722eea87082,0a71955b44411f90] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:02:59.945 INFO 9 --- [ocp-schedules-24,4987afe3ca5aa3c7,240d2aba0c7d3bf5] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:02:59.945 INFO 9 --- [host-check-agent-status1,8a433722eea87082,5ad52f5fb85a7d34] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:02:59.945 INFO 9 --- [host-check-clockdiff1,4987afe3ca5aa3c7,d511a01684ab27d6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:02:59.945 INFO 9 --- [host-check-agent-status2,8a433722eea87082,4f168fa9766ff055] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:02:59.945 INFO 9 --- [host-check-clockdiff2,4987afe3ca5aa3c7,8e5881c729757731] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:02:59.945 INFO 9 --- [host-check-agent-status3,8a433722eea87082,cf9c2299313ed45c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:02:59.946 INFO 9 --- [host-check-clockdiff3,4987afe3ca5aa3c7,d9e7afcf634ef8ac] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:02:59.946 INFO 9 --- [host-check-agent-status4,8a433722eea87082,631d68f4f17a7385] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:02:59.946 INFO 9 --- [host-check-clockdiff4,4987afe3ca5aa3c7,9c50992c1c217f09] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:02:59.946 INFO 9 --- [host-check-agent-status5,8a433722eea87082,c084d50759ff3528] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:02:59.946 INFO 9 --- [host-check-clockdiff5,4987afe3ca5aa3c7,51029ac33f4a068e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:02:59.946 INFO 9 --- [host-check-agent-status6,8a433722eea87082,9a6d970e20f9a653] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:02:59.946 INFO 9 --- [host-check-clockdiff6,4987afe3ca5aa3c7,9d3cc3f3f986ea5a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:02:59.952 INFO 9 --- [ocp-schedules-8,bf286108ac04dc21,363eda54079bc25b] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:02:59.956 INFO 9 --- [host-check-clockdiff2,4987afe3ca5aa3c7,8e5881c729757731] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002579 -2 -2 , error= 2025-09-16 14:02:59.956 INFO 9 --- [host-check-clockdiff5,4987afe3ca5aa3c7,51029ac33f4a068e] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002579 -1 -1 , error= 2025-09-16 14:02:59.956 INFO 9 --- [host-check-clockdiff4,4987afe3ca5aa3c7,9c50992c1c217f09] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002579 -1 -1 , error= 2025-09-16 14:02:59.957 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:02:59.957 INFO 9 --- [host-check-clockdiff3,4987afe3ca5aa3c7,d9e7afcf634ef8ac] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002579 -1 -1 , error= 2025-09-16 14:02:59.958 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:59.958 INFO 9 --- [host-check-agent-status2,8a433722eea87082,4f168fa9766ff055] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:02:59.958 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:02:59.958 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:02:59.958 INFO 9 --- [host-check-agent-status4,8a433722eea87082,631d68f4f17a7385] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:59.958 INFO 9 --- [host-check-agent-status6,8a433722eea87082,9a6d970e20f9a653] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:59.958 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:59.958 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:59.958 INFO 9 --- [host-check-agent-status3,8a433722eea87082,cf9c2299313ed45c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:02:59.958 INFO 9 --- [host-check-agent-status1,8a433722eea87082,5ad52f5fb85a7d34] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:02:59.958 INFO 9 --- [host-check-clockdiff1,4987afe3ca5aa3c7,d511a01684ab27d6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002579 -1 -1 , error= 2025-09-16 14:02:59.959 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:59.959 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:02:59.959 INFO 9 --- [host-check-agent-status4,8a433722eea87082,631d68f4f17a7385] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:59.959 INFO 9 --- [host-check-agent-status2,8a433722eea87082,4f168fa9766ff055] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:02:59.959 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:02:59.959 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:02:59.959 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:59.959 INFO 9 --- [host-check-agent-status3,8a433722eea87082,cf9c2299313ed45c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:02:59.959 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:59.959 INFO 9 --- [host-check-agent-status1,8a433722eea87082,5ad52f5fb85a7d34] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:02:59.959 INFO 9 --- [host-check-agent-status6,8a433722eea87082,9a6d970e20f9a653] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:59.960 INFO 9 --- [host-check-agent-status5,8a433722eea87082,c084d50759ff3528] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:59.961 INFO 9 --- [host-check-agent-status5,8a433722eea87082,c084d50759ff3528] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:59.973 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:02:59.973 INFO 9 --- [host-check-agent-status6,8a433722eea87082,9a6d970e20f9a653] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:02:59.973 INFO 9 --- [host-check-agent-status2,8a433722eea87082,4f168fa9766ff055] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:02:59.973 INFO 9 --- [host-check-agent-status1,8a433722eea87082,5ad52f5fb85a7d34] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:02:59.973 INFO 9 --- [host-check-agent-status4,8a433722eea87082,631d68f4f17a7385] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:02:59.974 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:02:59.974 INFO 9 --- [host-check-agent-status3,8a433722eea87082,cf9c2299313ed45c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:02:59.974 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:02:59.974 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:02:59.973452811+08:00 2025-09-16 14:02:59.974 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:02:59.975 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:02:59.974+08:00 2025-09-16 14:02:59.975 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:02:59.975 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:02:59.975 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:02:59.973916427+08:00 2025-09-16 14:02:59.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:59.975 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:02:59.975+08:00 2025-09-16 14:02:59.976 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:02:59.974806743+08:00 2025-09-16 14:02:59.976 INFO 9 --- [host-check-agent-status5,8a433722eea87082,c084d50759ff3528] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:02:59.976 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:02:59.974784735+08:00 2025-09-16 14:02:59.976 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:02:59.976+08:00 2025-09-16 14:02:59.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:02:59.976 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:02:59.976+08:00 2025-09-16 14:02:59.976 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:02:59.975639901+08:00 2025-09-16 14:02:59.976 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:02:59.974+08:00 and status AVAILABLE 2025-09-16 14:02:59.977 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:02:59.975538184+08:00 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status4,8a433722eea87082,631d68f4f17a7385] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:02:59.977 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:02:59.976+08:00 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status4,8a433722eea87082,631d68f4f17a7385] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status4,8a433722eea87082,631d68f4f17a7385] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status6,8a433722eea87082,9a6d970e20f9a653] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status6,8a433722eea87082,9a6d970e20f9a653] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status6,8a433722eea87082,9a6d970e20f9a653] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status3,8a433722eea87082,cf9c2299313ed45c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status3,8a433722eea87082,cf9c2299313ed45c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:02:59.977 INFO 9 --- [host-check-agent-status3,8a433722eea87082,cf9c2299313ed45c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:02:59.977 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:02:59.977+08:00 2025-09-16 14:02:59.977 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:02:59.975+08:00 and status AVAILABLE 2025-09-16 14:02:59.978 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:02:59.976+08:00 and status AVAILABLE 2025-09-16 14:02:59.978 INFO 9 --- [host-check-agent-status2,8a433722eea87082,4f168fa9766ff055] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:02:59.978 INFO 9 --- [host-check-agent-status2,8a433722eea87082,4f168fa9766ff055] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:02:59.978 INFO 9 --- [host-check-agent-status2,8a433722eea87082,4f168fa9766ff055] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:02:59.978 INFO 9 --- [host-check-agent-status1,8a433722eea87082,5ad52f5fb85a7d34] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:02:59.978 INFO 9 --- [host-check-agent-status1,8a433722eea87082,5ad52f5fb85a7d34] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:02:59.978 INFO 9 --- [host-check-agent-status1,8a433722eea87082,5ad52f5fb85a7d34] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:02:59.978 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:02:59.976+08:00 and status AVAILABLE 2025-09-16 14:02:59.978 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:02:59.976+08:00 and status AVAILABLE 2025-09-16 14:02:59.979 INFO 9 --- [host-check-agent-status5,8a433722eea87082,c084d50759ff3528] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:02:59.979 INFO 9 --- [host-check-agent-status5,8a433722eea87082,c084d50759ff3528] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:02:59.979 INFO 9 --- [host-check-agent-status5,8a433722eea87082,c084d50759ff3528] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:02:59.979 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:02:59.977+08:00 and status AVAILABLE 2025-09-16 14:02:59.980 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:02:59.981 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:02:59.981 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:02:59.981 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:02:59.981 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:02:59.981 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:02:59.982 INFO 9 --- [ocp-schedules-20,fc23ea917bd9ff0c,5c81808b9a567ad4] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:02:59.983 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:02:59.986 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:02:59.987 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:02:59.987 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:02:59.987 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:02:59.987 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:02:59.988 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:02:59.988 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:02:59.988 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:02:59.988 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:02:59.988 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:02:59.989 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:02:59.990 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:02:59.990 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:02:59.991 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:03:00.000 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:00.002 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:00.002 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:00.002 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:00.003 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:00.005 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:03:00.004234+08:00, lastProcessTime=2025-09-16T14:02:50.003822+08:00 2025-09-16 14:03:00.027 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:03:00.030 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:03:00.030 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:03:00.031 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:03:00.032 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:03:00.032 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:00.032 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:03:00.033 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:00.034 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:03:00.035 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:03:00.036 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:03:00.037 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:03:00.038 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:03:00.038 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:03:00.039 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:03:00.047 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:00.048 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:00.048 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:00.050 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:00.051 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:00.051 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:00.069 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:00.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:00.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:03:00.075 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:00.075 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:03:00.077 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:03:00.077 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:03:00.078 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:00.078 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:03:00.080 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:03:00.081 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:03:00.081 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:03:00.082 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:03:00.084 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:03:00.085 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:03:00.087 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:03:00.088 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:03:00.088 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:03:00.094 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.094 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:00.094 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:00.096 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:00.097 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:00.099 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:00.099 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:00.099 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:00.110 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.110 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:00.123 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:03:00.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:00.125 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:03:00.126 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:03:00.126 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:03:00.127 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:03:00.128 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:03:00.131 INFO 9 --- [host-check-host-status4,1b13fcc01d9d3d73,91ee3e4bddfae086] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:03:00.132 INFO 9 --- [host-check-host-status3,1b13fcc01d9d3d73,f931135c80864d29] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:03:00.133 INFO 9 --- [host-check-host-status5,1b13fcc01d9d3d73,2c0a9f58c5779781] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:03:00.133 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:03:00.004234+08:00 2025-09-16 14:03:00.133 INFO 9 --- [host-check-host-status2,1b13fcc01d9d3d73,dc924a682939d544] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:03:00.133 INFO 9 --- [host-check-host-status1,1b13fcc01d9d3d73,68d4c7cabfe31cb7] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:03:00.135 INFO 9 --- [host-check-host-status6,1b13fcc01d9d3d73,6f126b8632fb0e15] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:03:00.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.143 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:00.157 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.157 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:00.173 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.173 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:00.187 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.187 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:00.190 INFO 9 --- [ocp-async-5,46eeb6b7d12e0a9f,67ccd2d770d7deed] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:03:00.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.203 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:00.217 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.217 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:00.233 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:00.247 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:00.248 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:00.249 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:03:00.253 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:03:00.257 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:03:00.260 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:00.261 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:00.274 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:03:00.335 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:03:00.348 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:00.350 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:00.351 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:03:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:03:00.366 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:03:00.366 INFO 9 --- [ocp-schedules-10,9604c2a9a0db9f37,ea9878d96ef2dfdd] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:03:00.420 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,62cb940e3c37db9d,ed83f1c4be714047] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=62cb940e3c37db9d, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:00.436 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,62cb940e3c37db9d,ed83f1c4be714047] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=62cb940e3c37db9d, duration=18 ms] 2025-09-16 14:03:00.639 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:00.640 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:00.822 WARN 9 --- [ocp-async-1,4d44ced30b757451,c6e866533721d715] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:00.822 INFO 9 --- [ocp-async-9,92ce66616bce5368,b3d2e39ce39b4b41] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:00.880 INFO 9 --- [ocp-schedules-20,6441e6e6b01d0f01,e4401629995997b4] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:03:01.534 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,5e685c7aa65b933f,75666863f827480d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=5e685c7aa65b933f, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:01.550 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,5e685c7aa65b933f,75666863f827480d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=5e685c7aa65b933f, duration=19 ms] 2025-09-16 14:03:01.636 INFO 9 --- [prometheus-minute-schedule-1,182b1d906ca7787d,8281419e42e76ea9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:01.639 INFO 9 --- [prometheus-minute-schedule-1,182b1d906ca7787d,8281419e42e76ea9] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:01.731 INFO 9 --- [host-check-clockdiff6,4987afe3ca5aa3c7,9d3cc3f3f986ea5a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002581 -2 -2 , error= 2025-09-16 14:03:02.699 INFO 9 --- [ocp-schedules-22,7923b09c1fb52dfe,d5385c2e9f9c0e4e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:03:02.705 WARN 9 --- [scanner-1391014-1,7923b09c1fb52dfe,86953794eff4d4bf] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:03:02.715 INFO 9 --- [alarm-detect-3,7923b09c1fb52dfe,d5181d425600c2f6] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:03:02.717 INFO 9 --- [alarm-detect-16,7923b09c1fb52dfe,48096f14c82a81df] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:03:02.717 INFO 9 --- [alarm-detect-7,7923b09c1fb52dfe,b8dd96921b973cd3] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:03:02.730 INFO 9 --- [alarm-detect-18,7923b09c1fb52dfe,98ce806fae3ddcb2] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:03:02.822 WARN 9 --- [ocp-async-5,abacd39b699e2c56,0849c9322e243216] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:02.823 INFO 9 --- [ocp-async-4,6ebfab528787c082,14e3500162e128af] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:02.898 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,1325e069d3f4bd9e,a56b9970095e2c27] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=1325e069d3f4bd9e, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:02.914 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,1325e069d3f4bd9e,a56b9970095e2c27] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=1325e069d3f4bd9e, duration=18 ms] 2025-09-16 14:03:03.640 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:03.640 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:04.636 INFO 9 --- [prometheus-minute-schedule-1,a44761ef6529eb29,0159744163c15e59] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:04.639 INFO 9 --- [prometheus-minute-schedule-1,a44761ef6529eb29,0159744163c15e59] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:04.823 WARN 9 --- [ocp-async-6,342064161abbcdbb,aaf070c5cb129283] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:04.823 INFO 9 --- [ocp-async-2,de94a4e156435d81,9283657dd42559d0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:04.898 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,121a72c4d6fcb4cf,37fc2b907a01fb53] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=121a72c4d6fcb4cf, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:04.914 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,121a72c4d6fcb4cf,37fc2b907a01fb53] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=121a72c4d6fcb4cf, duration=19 ms] 2025-09-16 14:03:04.943 INFO 9 --- [ocp-schedules-11,8e8badbf0b92497b,f789ae43505a532b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:03:05.953 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,80ba946db8a8f56d,945792b4c757ad90] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=80ba946db8a8f56d, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 14:03:05.953 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,80ba946db8a8f56d,945792b4c757ad90] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=80ba946db8a8f56d, duration=1 ms] 2025-09-16 14:03:06.640 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:06.641 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:06.823 WARN 9 --- [ocp-async-7,cb4a0944d44fc9af,d9b21f1ae3abbe85] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:06.823 INFO 9 --- [ocp-async-1,28a601dcf5c0496a,9773d75a318eaf77] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:06.898 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,803009722c7eef61,287e46268027ed71] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=803009722c7eef61, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:06.914 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,803009722c7eef61,287e46268027ed71] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=803009722c7eef61, duration=19 ms] 2025-09-16 14:03:07.636 INFO 9 --- [prometheus-minute-schedule-1,0debdc9693b6a11d,4f778e58a95c8450] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:07.639 INFO 9 --- [prometheus-minute-schedule-1,0debdc9693b6a11d,4f778e58a95c8450] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:08.823 INFO 9 --- [ocp-async-9,d9d93ed4db004ec5,be2e14b19edec74e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:08.823 WARN 9 --- [ocp-async-5,dd835bc8231b9aba,d59698e94787c3d1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:08.882 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,84e34af20d64b209] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1401, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:08.901 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,196cd88bc2bacd01,e04e9d1c92a399b0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=196cd88bc2bacd01, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:08.918 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,196cd88bc2bacd01,e04e9d1c92a399b0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=196cd88bc2bacd01, duration=20 ms] 2025-09-16 14:03:09.411 INFO 9 --- [ocp-schedules-8,06e8e35b69fda2a4,75430e25d7a68eab] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:03:09.413 INFO 9 --- [ocp-schedules-8,06e8e35b69fda2a4,75430e25d7a68eab] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:03:09.641 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:09.642 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:09.893 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,ab399834033e91c5] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1362, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:09.900 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,ab399834033e91c5] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1370, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:09.906 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,ab399834033e91c5] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1394, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:10.003 INFO 9 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=3 2025-09-16 14:03:10.004 INFO 9 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=3 2025-09-16 14:03:10.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:03:10.003278+08:00, lastProcessTime=2025-09-16T14:03:00.004234+08:00 2025-09-16 14:03:10.120 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:03:10.003278+08:00 2025-09-16 14:03:10.190 INFO 9 --- [ocp-async-7,a5f1dd153b3f9a0a,26020df8de30daa9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:03:10.296 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 14:03:10.636 INFO 9 --- [prometheus-minute-schedule-1,07ca9e26909fb0e0,e08a3372737b8d28] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:10.639 INFO 9 --- [prometheus-minute-schedule-1,07ca9e26909fb0e0,e08a3372737b8d28] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:10.823 WARN 9 --- [ocp-async-10,4525a4f338fa3da4,c045f639dd37fd45] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:10.823 INFO 9 --- [ocp-async-6,ff2ba94c7df2d3db,1aa092dac49fc343] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:10.903 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,02822b02e2e2c457,418b5e2634aacd06] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=02822b02e2e2c457, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:10.917 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,80b2285d348d26a7] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1376, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:10.920 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,02822b02e2e2c457,418b5e2634aacd06] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=02822b02e2e2c457, duration=19 ms] 2025-09-16 14:03:11.774 INFO 9 --- [metric-archive-async-4,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002520, nodeCount=463, affectRows=463 2025-09-16 14:03:11.930 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,d26e5844fea96027] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1354, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:11.940 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,d26e5844fea96027] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1382, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:11.945 INFO 9 --- [metric-archive-minute-1,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=735, affectRows=735 2025-09-16 14:03:11.945 INFO 9 --- [metric-archive-minute-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=735, validCount=735 2025-09-16 14:03:11.946 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,d26e5844fea96027] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1390, operation:EXECUTE, state: RUNNING 2025-09-16 14:03:11.957 INFO 9 --- [metric-archive-minute-2,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=683, affectRows=683 2025-09-16 14:03:11.957 INFO 9 --- [metric-archive-minute-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=683, validCount=683 2025-09-16 14:03:11.966 INFO 9 --- [metric-archive-minute-4,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=982, affectRows=982 2025-09-16 14:03:11.966 INFO 9 --- [metric-archive-minute-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=982, validCount=982 2025-09-16 14:03:12.012 INFO 9 --- [metric-archive-minute-4,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=203, affectRows=203 2025-09-16 14:03:12.012 INFO 9 --- [metric-archive-minute-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=203, validCount=203 2025-09-16 14:03:12.024 INFO 9 --- [metric-archive-minute-5,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=1000, affectRows=1000 2025-09-16 14:03:12.024 INFO 9 --- [metric-archive-minute-5,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=1000, validCount=1000 2025-09-16 14:03:12.027 INFO 9 --- [metric-archive-minute-3,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=1000, affectRows=1000 2025-09-16 14:03:12.027 INFO 9 --- [metric-archive-minute-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=1000, validCount=1000 2025-09-16 14:03:12.074 INFO 9 --- [metric-archive-minute-1,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=1000, affectRows=1000 2025-09-16 14:03:12.074 INFO 9 --- [metric-archive-minute-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=1000, validCount=1000 2025-09-16 14:03:12.091 INFO 9 --- [metric-archive-minute-2,,] c.o.ocp.monitor.store.MetricDataStore : storeMetricHourDataEntity, MetricHourDataEntity=1000, affectRows=1000 2025-09-16 14:03:12.091 INFO 9 --- [metric-archive-minute-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup minute to hour, timestamp=1757998800, nodeCount=1000, validCount=1000 2025-09-16 14:03:12.223 INFO 9 --- [task-coordinator1,,] c.o.o.c.t.e.c.worker.RunningTaskWorker : Mark failed task, entity=TaskInstanceEntity{id=827, name='Create obproxy cluster', taskDefinitionId=-1, state=RUNNING, type=MANUAL, clusterId=null, tenantId=null, hostId=null, creator='admin', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false, obproxy_run_path=/home/admin/obproxy, service_name=obproxy_zq, install_path=/home/admin/obproxy, obproxy_parameter_version=1, obproxy_cluster_id=4, obproxy_cluster_name=obproxy_zq, obproxy_proxyro_password=xxx former_obproxy_cluster_status=LOCK, obproxy_need_delete_cluster=true, ocpagent_service_name=proxy_agent, package_version=4.3.5.0-3, operation_scope=Cluster, rpm_name=obproxy-ce-4.3.5.0-3.el7.aarch64.rpm, package_name=obproxy-ce, target_obproxy_cluster_status=UNLOCK}, listMap={commands_to_check=[nc], obproxy_server_ids=[10, 11, 12], process_keywords=[obproxy, obproxyd.sh], host_ids=[10, 12, 11]}}, createTime=2025-09-16T14:02:33+08:00, startTime=2025-09-16T14:02:33.801+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=1358, name=Sync obproxy parameter, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.internal.task.SyncObproxyParameterTask, seriesId=55, startTime=null, endTime=null}, SubtaskInstanceEntity{id=1379, name=Update obproxy status, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.internal.task.UpdateObproxyStatusTask, seriesId=22, startTime=null, endTime=null}, SubtaskInstanceEntity{id=1403, name=Assign proxy_id to obproxy, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.internal.task.AssignObproxyIdTask, seriesId=43, startTime=null, endTime=null}, SubtaskInstanceEntity{id=1366, name=Start obproxy process, state=SUCCESSFUL, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.internal.task.StartObproxyTask, seriesId=8, startTime=2025-09-16T14:02:57.839+08:00, endTime=2025-09-16T14:03:08.041+08:00}, SubtaskInstanceEntity{id=1370, name=Wait obproxy accessible, state=SUCCESSFUL, operation=EXECUTE, className=com.oceanbase.ocp.obproxyops.i 2025-09-16 14:03:12.230 WARN 9 --- [task-coordinator1,,] c.o.o.c.t.e.c.worker.RunningTaskWorker : Execute hook failed, ex: java.lang.NumberFormatException: null at java.lang.Long.parseLong(Long.java:552) at java.lang.Long.parseLong(Long.java:631) at com.oceanbase.ocp.core.task.common.Context.getLong(Context.java:200) at com.oceanbase.ocp.service.operation.OperationAlarmService.infoAfterTaskTerminate(OperationAlarmService.java:187) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.lambda$executePostTaskHooks$5(RunningTaskWorker.java:161) at java.util.ArrayList.forEach(ArrayList.java:1259) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.executePostTaskHooks(RunningTaskWorker.java:159) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.lockAndScheduleRunningTask(RunningTaskWorker.java:113) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.work(RunningTaskWorker.java:79) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.nonExceptionRun(TaskCoordinator.java:118) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$initRunningTaskWorkers$3(TaskCoordinator.java:105) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:03:12.231 INFO 9 --- [task-coordinator1,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:827, status:FAILED 2025-09-16 14:03:12.642 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:12.642 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:12.732 INFO 9 --- [ocp-schedules-25,b8d83f91c1850c97,4adb515a476c76aa] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:03:12.737 WARN 9 --- [scanner-1392051-1,b8d83f91c1850c97,d0c8a25810e6bfa1] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:03:12.823 INFO 9 --- [ocp-async-7,9b46d85d234719b6,244f3a5297d93452] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:12.823 WARN 9 --- [ocp-async-3,36ccaa6c0c40b2b0,5cc22178213b4f3c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:12.900 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,65de3dac22ca99db,51190dd0305b4d1c] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827?taskInstanceId=827, client=10.232.140.0, traceId=65de3dac22ca99db, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=827,] 2025-09-16 14:03:12.902 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002520, nodeCount=1000, affectRows=1000 2025-09-16 14:03:12.905 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002520, nodeCount=1000, validCount=996 2025-09-16 14:03:12.917 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,65de3dac22ca99db,51190dd0305b4d1c] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827 client=10.232.140.0, traceId=65de3dac22ca99db, duration=21 ms] 2025-09-16 14:03:12.929 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002520, nodeCount=1000, affectRows=1000 2025-09-16 14:03:12.931 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002520, nodeCount=1000, validCount=998 2025-09-16 14:03:12.942 ERROR 9 --- [metric-archive-second-1,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697672) Duplicate entry '824401952633176064-1758002460' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697672) Duplicate entry '824401952633176064-1758002460' for key 'PRIMARY' 2025-09-16 14:03:13.423 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002520, nodeCount=855, affectRows=855 2025-09-16 14:03:13.426 INFO 9 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002520, nodeCount=855, validCount=854 2025-09-16 14:03:13.636 INFO 9 --- [prometheus-minute-schedule-1,65ad7f43db3b79c0,82c52c4282d0fb66] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:13.639 INFO 9 --- [prometheus-minute-schedule-1,65ad7f43db3b79c0,82c52c4282d0fb66] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:14.201 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002520, nodeCount=1000, affectRows=1000 2025-09-16 14:03:14.204 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002520, nodeCount=991, validCount=944 2025-09-16 14:03:14.823 INFO 9 --- [ocp-async-5,11dc9147b3cff893,8c9e1a6da03e4bbc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:14.823 WARN 9 --- [ocp-async-8,80cba2226c532a4f,b624d535ce95d215] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:14.825 INFO 9 --- [ocp-schedules-14,010c6c24b1fb9a15,784f605b13c9be44] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:03:14.830 INFO 9 --- [ocp-schedules-14,010c6c24b1fb9a15,784f605b13c9be44] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:03:14.830 INFO 9 --- [ocp-schedules-14,010c6c24b1fb9a15,784f605b13c9be44] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:03:14.946 INFO 9 --- [ocp-schedules-29,73ebc779dd6d4439,37419013c31bf603] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:03:15.642 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:15.643 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:16.636 INFO 9 --- [prometheus-minute-schedule-1,02a23533dc556169,03b4d4aaeddd2cf3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:16.639 INFO 9 --- [prometheus-minute-schedule-1,02a23533dc556169,03b4d4aaeddd2cf3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:16.823 WARN 9 --- [ocp-async-10,735109ce9ee5e191,fef0cec1e35068aa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:16.823 INFO 9 --- [ocp-async-4,fb5d6da766849e22,e245ff40e73c8f29] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:18.643 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:18.644 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:18.823 INFO 9 --- [ocp-async-6,71bf843bc5485f7a,ae01306ffe441099] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:18.823 WARN 9 --- [ocp-async-3,9f0a71df3a24c244,fba1eb736dd4f4f5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:19.418 INFO 9 --- [ocp-schedules-10,ce2694bb699afc53,628859b95c4fc444] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:03:19.420 INFO 9 --- [ocp-schedules-10,ce2694bb699afc53,628859b95c4fc444] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:03:19.636 INFO 9 --- [prometheus-minute-schedule-1,ea98419f741c5b5d,65577526efbccae6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:19.639 INFO 9 --- [prometheus-minute-schedule-1,ea98419f741c5b5d,65577526efbccae6] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:03:20.003508+08:00, lastProcessTime=2025-09-16T14:03:10.003278+08:00 2025-09-16 14:03:20.122 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:03:20.003508+08:00 2025-09-16 14:03:20.190 INFO 9 --- [ocp-async-10,87982c22aa7e8c45,845876fcdeadcb2b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:03:20.636 INFO 9 --- [prometheus-cache-monitor1,d67d5b890bec0d57,0ecbb5f485a692ce] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15414,"minuteWriteQueue":0,"minuteReadCacheSize":7203,"secondWriteCacheSize":3811,"seriesIdKeySize":16772,"secondWriteQueue":0,"minuteWriteCacheSize":7198} 2025-09-16 14:03:20.636 INFO 9 --- [prometheus-cache-monitor1,d67d5b890bec0d57,0ecbb5f485a692ce] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:03:20.824 WARN 9 --- [ocp-async-9,48ba666c5051ecf1,d576401049d67f5b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:20.824 INFO 9 --- [ocp-async-8,5decefef2abf3e68,16799c93c76e43ac] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:21.644 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:21.644 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:22.636 INFO 9 --- [prometheus-minute-schedule-1,0238cf300f58baab,e826d867a4584a33] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:22.639 INFO 9 --- [prometheus-minute-schedule-1,0238cf300f58baab,e826d867a4584a33] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:22.759 INFO 9 --- [ocp-schedules-24,65b1e9e51f2f8fb3,52a625d2e9e51369] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:03:22.764 WARN 9 --- [scanner-1392177-1,65b1e9e51f2f8fb3,d9e492597ee0b444] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:03:22.774 INFO 9 --- [alarm-detect-12,65b1e9e51f2f8fb3,687a13dd1dae0be9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:03:22.776 INFO 9 --- [alarm-detect-6,65b1e9e51f2f8fb3,469e4b81ebe3f6a7] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:03:22.776 INFO 9 --- [alarm-detect-19,65b1e9e51f2f8fb3,b3f99f2ce2e7c681] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:03:22.788 INFO 9 --- [alarm-detect-1,65b1e9e51f2f8fb3,ca501119d32b4d0a] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:03:22.824 INFO 9 --- [ocp-async-10,9c2823f1960b38b0,bcdd4fb5dbe02af4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:22.824 WARN 9 --- [ocp-async-2,96df434f7ac4f463,44c45721ec57db08] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:24.645 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:24.645 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:24.824 INFO 9 --- [ocp-async-3,b02c6a2d7d8d0116,3e0ec4a88bc11d9e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:24.824 WARN 9 --- [ocp-async-1,678aa653d12456dd,c58381ee29ab5c3b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:24.950 INFO 9 --- [ocp-schedules-10,8b3182fcfdf2404f,ff72e44b6a401d65] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:03:25.636 INFO 9 --- [prometheus-minute-schedule-1,556826f78365c8d5,73fcb9b1e455ee07] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:25.639 INFO 9 --- [prometheus-minute-schedule-1,556826f78365c8d5,73fcb9b1e455ee07] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:26.824 INFO 9 --- [ocp-async-7,9290f24938f007b5,06f16f6aab9ea009] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:26.824 WARN 9 --- [ocp-async-9,dcdc095b9ff3966f,406f171e4e5714e0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:27.645 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:27.646 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:28.636 INFO 9 --- [prometheus-minute-schedule-1,4cc8cbd3c13f990d,fc26828dc2c055eb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:28.640 INFO 9 --- [prometheus-minute-schedule-1,4cc8cbd3c13f990d,fc26828dc2c055eb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:28.824 INFO 9 --- [ocp-async-8,19c4672b48c3e605,d65dbe9138f010db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:28.824 WARN 9 --- [ocp-async-2,eb2d0bd9d8016451,e1f8c690e520f6f6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:29.425 INFO 9 --- [ocp-schedules-20,dc2a57cf5c771d0a,fe651b8673b2f23c] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:03:29.427 INFO 9 --- [ocp-schedules-20,dc2a57cf5c771d0a,fe651b8673b2f23c] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:03:29.613 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,50aed705921782e8,aa46a6b4d5056b82] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=50aed705921782e8, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:03:29.613 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,50aed705921782e8,aa46a6b4d5056b82] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=50aed705921782e8, duration=1 ms] 2025-09-16 14:03:29.615 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,c2fc1e7515d5de95,68135267cd094658] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=c2fc1e7515d5de95, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:03:29.615 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,c2fc1e7515d5de95,68135267cd094658] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=c2fc1e7515d5de95, duration=1 ms] 2025-09-16 14:03:29.938 INFO 9 --- [ocp-schedules-30,90d545c30d27250d,5a95d2dcf4a6ce43] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:03:29.941 INFO 9 --- [ocp-schedules-19,b233a7d2b935cb11,e22dbccdca58142c] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:03:29.941 INFO 9 --- [ocp-schedules-17,6b5645e9a442412b,b307547baf4f40a9] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:03:29.942 INFO 9 --- [ocp-schedules-4,1006e12fc0922204,142dfb75f420be3b] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:03:29.942 INFO 9 --- [ocp-schedules-17,6b5645e9a442412b,b307547baf4f40a9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:29.943 INFO 9 --- [ocp-schedules-19,b233a7d2b935cb11,e22dbccdca58142c] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:29.943 INFO 9 --- [ocp-schedules-4,1006e12fc0922204,142dfb75f420be3b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:29.943 INFO 9 --- [ocp-schedules-4,1006e12fc0922204,142dfb75f420be3b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:03:29.944 INFO 9 --- [ocp-schedules-7,9788672fd2bc2ab9,3a8a603d9119a08b] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:03:29.945 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [ocp-schedules-15,393b9505edee9d28,3b22ba6921914a1f] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:03:29.945 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-agent-status1,393b9505edee9d28,39fef739a2a9dc0d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-agent-status2,393b9505edee9d28,d781de71535cc427] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-agent-status3,393b9505edee9d28,cbefdf7549d7aee2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-agent-status4,393b9505edee9d28,f577036e298b6b65] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-agent-status5,393b9505edee9d28,e3445d66b7d68939] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:03:29.945 INFO 9 --- [host-check-agent-status6,393b9505edee9d28,c004740ed6dca71f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:03:29.946 INFO 9 --- [ocp-schedules-12,39eb756f0949dd04,9c6dbf1c9e85b3d5] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:03:29.946 INFO 9 --- [host-check-clockdiff1,39eb756f0949dd04,a8bbbc60daceaee6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:03:29.946 INFO 9 --- [host-check-clockdiff2,39eb756f0949dd04,4360ce52a5ab0e5d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:03:29.946 INFO 9 --- [host-check-clockdiff3,39eb756f0949dd04,f306c05c9387e28d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:03:29.947 INFO 9 --- [host-check-clockdiff4,39eb756f0949dd04,03c756bd92f7e3f6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:03:29.947 INFO 9 --- [host-check-clockdiff5,39eb756f0949dd04,00db2b03f75e232a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:03:29.947 INFO 9 --- [host-check-clockdiff6,39eb756f0949dd04,87aba8054c22ef89] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:03:29.948 INFO 9 --- [ocp-schedules-24,f9d3ee36f85c38dd,aecbf035298a09b6] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2025-09-16 14:03:29.948 INFO 9 --- [ocp-schedules-11,12a22ad762eb90e1,7455dca6a1ec6ada] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:03:29.948 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:29.951 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:29.951 INFO 9 --- [ocp-schedules-24,f9d3ee36f85c38dd,aecbf035298a09b6] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:29.951 INFO 9 --- [host-check-agent-status1,393b9505edee9d28,39fef739a2a9dc0d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:29.951 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:29.951 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:29.951 INFO 9 --- [host-check-agent-status2,393b9505edee9d28,d781de71535cc427] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:29.951 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:29.951 INFO 9 --- [host-check-agent-status4,393b9505edee9d28,f577036e298b6b65] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:29.952 INFO 9 --- [host-check-agent-status5,393b9505edee9d28,e3445d66b7d68939] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:29.952 INFO 9 --- [host-check-agent-status3,393b9505edee9d28,cbefdf7549d7aee2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:29.952 INFO 9 --- [host-check-agent-status6,393b9505edee9d28,c004740ed6dca71f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:29.952 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:29.955 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:29.955 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:29.955 INFO 9 --- [host-check-agent-status4,393b9505edee9d28,f577036e298b6b65] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:29.955 INFO 9 --- [host-check-agent-status2,393b9505edee9d28,d781de71535cc427] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:29.955 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:29.955 INFO 9 --- [host-check-agent-status1,393b9505edee9d28,39fef739a2a9dc0d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:29.955 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:29.955 INFO 9 --- [host-check-clockdiff3,39eb756f0949dd04,f306c05c9387e28d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002609 -1 -1 , error= 2025-09-16 14:03:29.955 INFO 9 --- [host-check-clockdiff1,39eb756f0949dd04,a8bbbc60daceaee6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002609 -1 -1 , error= 2025-09-16 14:03:29.955 INFO 9 --- [host-check-clockdiff5,39eb756f0949dd04,00db2b03f75e232a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002609 -1 -1 , error= 2025-09-16 14:03:29.955 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:29.955 INFO 9 --- [host-check-clockdiff2,39eb756f0949dd04,4360ce52a5ab0e5d] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002609 -1 -1 , error= 2025-09-16 14:03:29.957 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:29.957 INFO 9 --- [host-check-agent-status6,393b9505edee9d28,c004740ed6dca71f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:29.957 INFO 9 --- [host-check-agent-status3,393b9505edee9d28,cbefdf7549d7aee2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:29.957 INFO 9 --- [host-check-agent-status5,393b9505edee9d28,e3445d66b7d68939] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:29.960 INFO 9 --- [host-check-clockdiff6,39eb756f0949dd04,87aba8054c22ef89] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002609 -1 -1 , error= 2025-09-16 14:03:29.960 INFO 9 --- [host-check-clockdiff4,39eb756f0949dd04,03c756bd92f7e3f6] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002609 -1 -1 , error= 2025-09-16 14:03:29.962 INFO 9 --- [ocp-schedules-13,fbdf68844e612889,db60b8713af12495] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 14:03:29.963 INFO 9 --- [ocp-schedules-2,2acc998bd04e24c7,9e6e932118ec0977] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 14:03:29.968 INFO 9 --- [ocp-schedules-2,2acc998bd04e24c7,9e6e932118ec0977] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 14:03:29.968 INFO 9 --- [ocp-schedules-13,fbdf68844e612889,db60b8713af12495] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 14:03:29.971 INFO 9 --- [ocp-schedules-5,8ee8d47a682d4aa5,688bc49b5e983fc2] c.o.o.s.common.scheduled.OcpSchedules : Cleanup ocp connection pools. 2025-09-16 14:03:29.971 INFO 9 --- [ocp-schedules-5,8ee8d47a682d4aa5,688bc49b5e983fc2] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2025-09-16 14:03:29.974 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-agent-status1,393b9505edee9d28,39fef739a2a9dc0d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-agent-status3,393b9505edee9d28,cbefdf7549d7aee2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-agent-status5,393b9505edee9d28,e3445d66b7d68939] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:03:29.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:29.974 INFO 9 --- [host-check-agent-status2,393b9505edee9d28,d781de71535cc427] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:03:29.974 INFO 9 --- [host-check-agent-status4,393b9505edee9d28,f577036e298b6b65] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:03:29.975 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:03:29.975 INFO 9 --- [host-check-agent-status6,393b9505edee9d28,c004740ed6dca71f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:03:29.975 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:03:29.974435530+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:03:29.974716967+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:03:29.975085752+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:03:29.976+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:03:29.974986728+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:03:29.975373477+08:00 2025-09-16 14:03:29.976 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,5a6a7318262735b9,b649930bf51adc4a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/827/subtasks/1390/logSegments?taskInstanceId=827&subtaskInstanceId=1390, client=10.232.140.0, traceId=5a6a7318262735b9, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=827,1390,] 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:03:29.975576253+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:03:29.976+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:03:29.976+08:00 2025-09-16 14:03:29.976 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:03:29.976+08:00 2025-09-16 14:03:29.977 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:03:29.976+08:00 2025-09-16 14:03:29.977 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:03:29.976+08:00 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status3,393b9505edee9d28,cbefdf7549d7aee2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status3,393b9505edee9d28,cbefdf7549d7aee2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status3,393b9505edee9d28,cbefdf7549d7aee2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:03:29.978 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:03:29.976+08:00 and status AVAILABLE 2025-09-16 14:03:29.978 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:03:29.976+08:00 and status AVAILABLE 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status5,393b9505edee9d28,e3445d66b7d68939] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status5,393b9505edee9d28,e3445d66b7d68939] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status5,393b9505edee9d28,e3445d66b7d68939] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status1,393b9505edee9d28,39fef739a2a9dc0d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status1,393b9505edee9d28,39fef739a2a9dc0d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:03:29.978 INFO 9 --- [pool-overview-container-1,aacf06eb9490dce5,470882404ccfc040] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status6,393b9505edee9d28,c004740ed6dca71f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:03:29.978 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:03:29.976+08:00 and status AVAILABLE 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status6,393b9505edee9d28,c004740ed6dca71f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status1,393b9505edee9d28,39fef739a2a9dc0d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status6,393b9505edee9d28,c004740ed6dca71f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status2,393b9505edee9d28,d781de71535cc427] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status2,393b9505edee9d28,d781de71535cc427] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:03:29.978 INFO 9 --- [host-check-agent-status2,393b9505edee9d28,d781de71535cc427] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:03:29.978 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:03:29.976+08:00 and status AVAILABLE 2025-09-16 14:03:29.978 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:03:29.976+08:00 and status AVAILABLE 2025-09-16 14:03:29.978 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:03:29.976+08:00 and status AVAILABLE 2025-09-16 14:03:29.979 INFO 9 --- [host-check-agent-status4,393b9505edee9d28,f577036e298b6b65] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:03:29.979 INFO 9 --- [host-check-agent-status4,393b9505edee9d28,f577036e298b6b65] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:03:29.979 INFO 9 --- [host-check-agent-status4,393b9505edee9d28,f577036e298b6b65] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:03:29.979 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,5a6a7318262735b9,b649930bf51adc4a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/827/subtasks/1390/logSegments client=10.232.140.0, traceId=5a6a7318262735b9, duration=6 ms] 2025-09-16 14:03:29.980 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:03:29.980 INFO 9 --- [pool-overview-container-3,9d1e1dc96153d289,6895a5bd2ba93690] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 14:03:29.980 INFO 9 --- [ocp-schedules-17,6b5645e9a442412b,b307547baf4f40a9] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:03:29.981 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:03:29.982 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:29.982 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:03:29.982 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:03:29.982 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:03:29.982 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:03:29.982 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:03:29.982 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2025-09-16 14:03:29.987 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:29.988 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:29.988 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:29.988 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:29.988 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:29.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:29.988 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:29.989 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:03:29.989 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:29.989 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:29.989 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:29.990 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:29.991 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:29.994 INFO 9 --- [pool-12-thread-7,aacf06eb9490dce5,5839d933e92d137f] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get outline history 2025-09-16 14:03:29.994 INFO 9 --- [pool-12-thread-5,aacf06eb9490dce5,6cd1e823aaa4e6d3] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to get cluster trans stat 2025-09-16 14:03:29.994 INFO 9 --- [pool-12-thread-8,aacf06eb9490dce5,89a64f15c2293a73] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster session stat 2025-09-16 14:03:29.994 INFO 9 --- [pool-12-thread-6,aacf06eb9490dce5,e1cd6d2890764dc0] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get Cluster Sql Stat 2025-09-16 14:03:29.994 INFO 9 --- [pool-12-thread-6,aacf06eb9490dce5,e1cd6d2890764dc0] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster slow Sql Stat 2025-09-16 14:03:29.996 INFO 9 --- [ForkJoinPool-10-worker-3,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 14:03:29.996 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,dc64e98a813f9fbd,b6d91c0a8ecd96dc] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=zhengqi&ObClusterId=1&version=2, client=10.232.140.0, traceId=dc64e98a813f9fbd, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getRootServiceInfo(String,Long,String,Long,boolean,Integer), args=zhengqi,1,false,2,] 2025-09-16 14:03:29.996 INFO 9 --- [ForkJoinPool-10-worker-12,,] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2025-09-16 14:03:29.996 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,dc64e98a813f9fbd,b6d91c0a8ecd96dc] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=dc64e98a813f9fbd, duration=0 ms] 2025-09-16 14:03:29.997 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get tenant session stat of zhengqi 2025-09-16 14:03:29.997 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get session of zhengqi 2025-09-16 14:03:29.999 INFO 9 --- [pool-12-thread-5,aacf06eb9490dce5,6cd1e823aaa4e6d3] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to attach trans id 2025-09-16 14:03:29.999 INFO 9 --- [pool-12-thread-5,aacf06eb9490dce5,6cd1e823aaa4e6d3] c.o.o.p.t.i.ObTransactionDiagServiceImpl : finish fetching trans data 2025-09-16 14:03:29.999 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:29.999 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2025-09-16 14:03:30.004 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:30.004 INFO 9 --- [pool-overview-container-4,85585273ce477e41,0d1d559914d6e906] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.004 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:30.004 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:30.005 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:30.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:03:30.003417+08:00, lastProcessTime=2025-09-16T14:03:20.003508+08:00 2025-09-16 14:03:30.006 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:30.006 INFO 9 --- [pool-overview-container-4,85585273ce477e41,0d1d559914d6e906] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ SVR_IP, SVR_PORT, ZONE, CPU_CAPACITY, CPU_CAPACITY_MAX, CPU_ASSIGNED, CPU_ASSIGNED_MAX, MEM_CAPACITY, MEM_CAPACITY AS MEM_CAPACITY_MAX, MEM_ASSIGNED, MEM_ASSIGNED AS MEM_ASSIGNED_MAX, LOG_DISK_CAPACITY, LOG_DISK_ASSIGNED, LOG_DISK_IN_USE, DATA_DISK_CAPACITY, DATA_DISK_IN_USE FROM oceanbase.GV$OB_SERVERS 2025-09-16 14:03:30.006 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:30.012 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.014 INFO 9 --- [pool-12-thread-6,aacf06eb9490dce5,e1cd6d2890764dc0] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster anomaly sql Stat 2025-09-16 14:03:30.014 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.159, 2882] 2025-09-16 14:03:30.019 INFO 9 --- [pool-12-thread-6,aacf06eb9490dce5,e1cd6d2890764dc0] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching cluster sql stat 2025-09-16 14:03:30.020 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.021 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.021 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.021 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 14:03:30.022 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.111, 2882] 2025-09-16 14:03:30.023 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 14:03:30.023 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.025 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.104, 2882] 2025-09-16 14:03:30.026 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.026 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.026 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 14:03:30.028 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.85, 2882] 2025-09-16 14:03:30.029 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:30.029 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:03:30.031 INFO 9 --- [Check root service 1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.0.54, 2882] 2025-09-16 14:03:30.031 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:03:30.031 INFO 9 --- [ocp-schedules-24,f9d3ee36f85c38dd,aecbf035298a09b6] .o.o.s.t.b.c.AbstractShardingClusterTask : Check root service executed completed, allCount=1, successCount=1 2025-09-16 14:03:30.032 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:03:30.033 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:03:30.034 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:03:30.035 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:03:30.038 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 14:03:30.038 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:03:30.039 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:03:30.040 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.040 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:03:30.040 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:03:30.041 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 14:03:30.042 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:03:30.042 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:03:30.045 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.046 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 14:03:30.047 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:03:30.051 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:30.051 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.052 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 14:03:30.052 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:30.052 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:30.054 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:30.056 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:30.057 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.058 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 14:03:30.059 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:03:30.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:30.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:03:30.069 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.071 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 14:03:30.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.074 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:03:30.075 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:30.080 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:03:30.082 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:03:30.083 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:03:30.084 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:03:30.084 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.085 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? AND state = 'ACTIVE' 2025-09-16 14:03:30.085 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:03:30.087 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 14:03:30.087 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:03:30.087 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:03:30.088 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.089 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:03:30.089 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 14:03:30.089 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.090 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:03:30.090 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ COUNT(*) FROM GV$OB_PROCESSLIST WHERE 1=1 AND tenant = ? 2025-09-16 14:03:30.090 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.090 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:30.090 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:03:30.091 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:03:30.092 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.p.o.i.OasSessionStatServiceImpl : begin to get deadlock of zhengqi 2025-09-16 14:03:30.093 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.093 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:03:30.094 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 14:03:30.099 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:30.101 INFO 9 --- [prometheus-second-schedule-1,aebb7d4416c6f96c,fe6111f6b60cca8c] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 14:03:30.101 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:30.101 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:30.104 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:30.105 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:30.105 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:03:30.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:30.108 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=vas_ucs, dbUser=root 2025-09-16 14:03:30.113 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.114 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 14:03:30, 2025-09-16 14:03:30] 2025-09-16 14:03:30.118 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.119 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, case enabled when 'YES' then 1 else 0 end as enabled, create_time as gmt_create from DBA_OB_OUTLINE_CONCURRENT_HISTORY where ADDDATE(create_time, ?) > CURDATE() and is_deleted = 'NO' 2025-09-16 14:03:30.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.120 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:30.127 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:03:30.128 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:03:30.129 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:03:30.132 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:03:30.133 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:03:30.133 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:03:30.134 INFO 9 --- [host-check-host-status3,9788672fd2bc2ab9,303ebcb2ad9467b3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:03:30.135 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 14:03:30.135 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=root 2025-09-16 14:03:30.135 INFO 9 --- [host-check-host-status2,9788672fd2bc2ab9,6c62c6e56df47602] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:03:30.136 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.136 INFO 9 --- [host-check-host-status4,9788672fd2bc2ab9,4ef3578ae407d323] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:03:30.137 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.137 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.137 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:30.137 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2025-09-16 14:03:30.138 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 14:03:30, 2025-09-16 14:03:30] 2025-09-16 14:03:30.138 INFO 9 --- [host-check-host-status1,9788672fd2bc2ab9,b1ad4e2167432ee3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:03:30.139 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:03:30.003417+08:00 2025-09-16 14:03:30.139 INFO 9 --- [host-check-host-status6,9788672fd2bc2ab9,1f0ac1da2ce2f655] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:03:30.140 INFO 9 --- [host-check-host-status5,9788672fd2bc2ab9,5fb9f63d75c307eb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:03:30.142 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.143 INFO 9 --- [ForkJoinPool-10-worker-3,aacf06eb9490dce5,ce6299a0cf391fd9] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2025-09-16 14:03:30.144 INFO 9 --- [pool-12-thread-7,aacf06eb9490dce5,5839d933e92d137f] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2025-09-16 14:03:30.151 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.151 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:30.157 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=cos, dbUser=root 2025-09-16 14:03:30.158 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.159 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ event_id, svr_ip, svr_port, report_time, cycle_idx as cycle_index, cycle_size, role, visitor, object as queryResource, extra_name1, extra_value1 from DBA_OB_DEADLOCK_EVENT_HISTORY where report_time > ? and report_time < ?;, args: [2025-09-09 14:03:30, 2025-09-16 14:03:30] 2025-09-16 14:03:30.163 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.p.o.i.OasSessionStatServiceImpl : finish fetching tenant session data of zhengqi 2025-09-16 14:03:30.163 INFO 9 --- [ForkJoinPool-10-worker-12,aacf06eb9490dce5,f8c9fb0f150a3051] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching tenant session stat of zhengqi 2025-09-16 14:03:30.163 INFO 9 --- [pool-12-thread-8,aacf06eb9490dce5,89a64f15c2293a73] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2025-09-16 14:03:30.166 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.166 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:30.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:30.190 INFO 9 --- [ocp-async-5,b40c3c212cbfa366,55cdc805fe5af47b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:03:30.195 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.195 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:03:30.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:03:30.224 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:03:30.238 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:30.239 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.240 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:03:30.245 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:03:30.248 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:03:30.251 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:30.252 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:30.265 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:03:30.286 INFO 9 --- [ocp-schedules-4,ddebe11877b0e91a,9b5410a457a61d63] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 14:03:30.287 INFO 9 --- [ocp-schedules-4,ddebe11877b0e91a,9b5410a457a61d63] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:30.287 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 14:03:30.287 INFO 9 --- [ocp-schedules-4,ddebe11877b0e91a,9b5410a457a61d63] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:03:30.331 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:03:30.345 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:30.347 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:30.347 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:03:30.362 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:03:30.362 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:03:30.362 INFO 9 --- [ocp-schedules-19,b233a7d2b935cb11,e22dbccdca58142c] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:03:30.419 INFO 9 --- [ocp-schedules-29,fbab2046ef0f1764,7d26fb1b00b08dd1] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 14:03:30.609 INFO 9 --- [ocp-schedules-8,3e65f24a8022b570,9fee336b3188cf34] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 14:03:30.611 INFO 9 --- [ocp-schedules-8,3e65f24a8022b570,9fee336b3188cf34] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 14:03:30.611 INFO 9 --- [ocp-schedules-8,3e65f24a8022b570,9fee336b3188cf34] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 14:03:30.646 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:30.646 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:30.824 INFO 9 --- [ocp-async-3,1fb72fabfc4d9ace,358f73697eacc68b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:30.824 WARN 9 --- [ocp-async-9,22df269fe0be41b8,15d4a82d614c624d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:30.882 INFO 9 --- [ocp-schedules-24,bbfa6ac103f840e8,8dffe6b16a500e36] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:03:31.008 INFO 9 --- [ocp-schedules-14,61cc6efb162d8d3e,b3b2cf05cedda862] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 14:03:31.008 INFO 9 --- [ocp-schedules-14,61cc6efb162d8d3e,b3b2cf05cedda862] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 14:03:31.523 INFO 9 --- [ocp-schedules-30,6d7990a3b9818cf6,55634088a6cad296] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 14:03:31.523 INFO 9 --- [ocp-schedules-30,6d7990a3b9818cf6,55634088a6cad296] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002611 2025-09-16 14:03:31.523 INFO 9 --- [ocp-schedules-30,6d7990a3b9818cf6,55634088a6cad296] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 14:03:31.636 INFO 9 --- [prometheus-minute-schedule-1,c20960b15b637373,81e7c8280533f725] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:31.639 INFO 9 --- [prometheus-minute-schedule-1,c20960b15b637373,81e7c8280533f725] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:31.701 INFO 9 --- [ocp-schedules-4,7629e97fcb1ab095,0e446ab5e43484c5] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 14:03:31.731 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 14:03:31.731 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824445009273470976 2025-09-16 14:03:31.732 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=1, maxSyncedRecordId=824445193931898880 2025-09-16 14:03:31.733 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 14:03:31.733 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824408278851567616 2025-09-16 14:03:31.733 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=30, maxSyncedRecordId=824445282763063296 2025-09-16 14:03:31.734 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 14:03:31.734 INFO 9 --- [ocp-schedules-19,d092cddb8fd322e8,f9ee00afe2b68443] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 14:03:31.763 INFO 9 --- [ocp-schedules-25,d1d3e8f6ddae24b0,44a797bffa9d6bb3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 14:03:32.790 INFO 9 --- [ocp-schedules-1,4120fdd274b40e69,f315d6154731a47f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:03:32.795 WARN 9 --- [scanner-1392338-1,4120fdd274b40e69,bc78a500963afa59] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:03:32.824 INFO 9 --- [ocp-async-5,21adfa4a1590bb88,ac4f76fe26e46e87] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:32.824 WARN 9 --- [ocp-async-2,e338ccf14d77737c,85f1379ef9ee0eaf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:32.987 INFO 9 --- [ocp-schedules-3,9ad9e310ffa4982b,72e34fef89dcc719] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2025-09-16 14:03:32.987 INFO 9 --- [ocp-schedules-3,9ad9e310ffa4982b,72e34fef89dcc719] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2025-09-16 14:03:33.002 INFO 9 --- [pool-76-thread-1,9ad9e310ffa4982b,91e4d3f9834894f0] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect mini compaction info 2025-09-16 14:03:33.024 INFO 9 --- [pool-76-thread-1,9ad9e310ffa4982b,91e4d3f9834894f0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:33.027 INFO 9 --- [pool-76-thread-1,9ad9e310ffa4982b,91e4d3f9834894f0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, MIN(unix_timestamp(`start_time`)*1000000) AS min_start_time, MAX(unix_timestamp(`finish_time`)*1000000) AS max_finish_time, SUM(occupy_size) AS occupy_size, SUM(total_row_count) AS total_row_count, COUNT(1) AS tablet_count FROM GV$OB_TABLET_COMPACTION_HISTORY WHERE type = 'MINI_MERGE' AND unix_timestamp(`finish_time`)*1000000 > ? AND unix_timestamp(`finish_time`)*1000000 <= ? GROUP BY tenant_id;, args: [1758002312000000, 1758002613000000] 2025-09-16 14:03:33.047 INFO 9 --- [pool-76-thread-1,9ad9e310ffa4982b,91e4d3f9834894f0] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect mini compaction info 2025-09-16 14:03:33.047 INFO 9 --- [ocp-schedules-3,9ad9e310ffa4982b,72e34fef89dcc719] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2025-09-16 14:03:33.558 INFO 9 --- [ocp-schedules-10,f416eee95613d891,19a28994a34fd087] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 14:03:33.646 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:33.647 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:33.697 INFO 9 --- [ocp-schedules-8,8b57e3f14c457cbd,eb8f38673a4b96ea] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T14:03:33.697+08:00, clusters=[1] 2025-09-16 14:03:33.698 INFO 9 --- [ocp-schedules-8,8b57e3f14c457cbd,eb8f38673a4b96ea] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 14:03:34.272 INFO 9 --- [ocp-schedules-9,9e432da6dfd02d25,2016dee81e59162e] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 14:03:34.272 INFO 9 --- [ocp-schedules-9,9e432da6dfd02d25,2016dee81e59162e] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 14:03:34.272 INFO 9 --- [ocp-schedules-9,9e432da6dfd02d25,2016dee81e59162e] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 14:03:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 14:03:34.288 INFO 9 --- [ocp-schedules-9,9e432da6dfd02d25,2016dee81e59162e] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 14:03:34.636 INFO 9 --- [prometheus-minute-schedule-1,f027a9060d34cd78,b37ab0e9abb3320d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:34.639 INFO 9 --- [prometheus-minute-schedule-1,f027a9060d34cd78,b37ab0e9abb3320d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:34.824 INFO 9 --- [ocp-async-8,716cb1ca82a2adae,b2d23f8852017ba7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:34.824 WARN 9 --- [ocp-async-10,b65534d7ae467170,89338167bcb1f164] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:34.828 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2025-09-16 14:03:34.832 INFO 9 --- [ocp-schedules-10,34ff14b6d559c92d,1e0b547b6bbd0546] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:03:34.836 INFO 9 --- [ocp-schedules-10,34ff14b6d559c92d,1e0b547b6bbd0546] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:03:34.836 INFO 9 --- [ocp-schedules-10,34ff14b6d559c92d,1e0b547b6bbd0546] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:03:34.838 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:34.839 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:34.852 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:34.853 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:34.866 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:34.867 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:34.880 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:34.880 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:34.894 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:34.894 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:34.908 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:34.908 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:34.922 INFO 9 --- [ocp-schedules-21,e94cade65eb5b00c,7af9eef32ade7e5e] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper finished, credentialSize=6, cachedSize=6 2025-09-16 14:03:34.953 INFO 9 --- [ocp-schedules-8,96c08ac29eccf45e,693241efb8b57802] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:03:35.891 INFO 9 --- [ocp-schedules-7,4f694c9ee3571501,e4e0204fa681c4b2] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T14:03:35.891+08:00, clusters=[1] 2025-09-16 14:03:35.895 INFO 9 --- [ocp-schedules-7,4f694c9ee3571501,e4e0204fa681c4b2] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 14:03:36.647 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:36.648 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:36.824 WARN 9 --- [ocp-async-9,a2a2d0965b067efb,91e311f175db2242] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:36.824 INFO 9 --- [ocp-async-1,b5111f35cf45ace5,f13a3009ab14ccd3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:37.636 INFO 9 --- [prometheus-minute-schedule-1,2362565564bcac25,f76815b6b8759fb5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:37.639 INFO 9 --- [prometheus-minute-schedule-1,2362565564bcac25,f76815b6b8759fb5] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:38.124 INFO 9 --- [ocp-schedules-6,5d1323efcfbdfcd4,0a20a52b14c1da77] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 14:03:38.125 INFO 9 --- [ocp-schedules-6,5d1323efcfbdfcd4,0a20a52b14c1da77] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:38.145 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:38.146 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 14:03:38.159 INFO 9 --- [ocp-schedules-6,5d1323efcfbdfcd4,0a20a52b14c1da77] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_timeout, expression merge_timeout_flag == 1 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_timeout_flag', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_timeout 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_drop, expression net_receive_drop_count > 100 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_receive_drop_count', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_drop 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_cannot_connect_arbitration, expression arbitration_status_inactive_server_count > 0 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_status_inactive_server_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_cannot_connect_arbitration 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_cannot_connect_arbitration 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_leader_absent, expression tenant_partition_leader_absent_count > 100 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_leader_absent_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_leader_absent 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_leader_absent 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cpu_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cpu_percent_over_threshold 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_alarm_detect_timeout, expression ocp_alarm_detect_duration_seconds >= 3 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_alarm_detect_duration_seconds', labels={}}], alarmTargets 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_alarm_detect_timeout 2025-09-16 14:03:38.595 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_alarm_detect_timeout 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_retry_times_exceeded, expression storage_capacity_monitor_error_code == 1001 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_retry_times_exceeded 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ssl_certificate_is_expired, expression ssl_certificate_expired_status > 0 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ssl_certificate_expired_status', labels={}}], alarmTargets 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ssl_certificate_is_expired 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ssl_certificate_is_expired 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 95 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 92 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_log_path_disk_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_log_disk_percent_over_threshold 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_hwm, expression cpu_used_percent > 90 and cpu_steal < 20 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_steal', labels={}}, Metric{name='host_cpu_used_percent', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_hwm 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_hwm, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_hwm 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_cannot_connected, expression obproxy_connectable == 0 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_connectable', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_cannot_connected 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_recyclebin_disk_used_over_threshold, expression ob_database_disk_used_gb > 100 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_recyclebin_disk_used_gb', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_recyclebin_disk_used_over_threshold 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_recyclebin_disk_used_over_threshold 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for cluster_cgroup_value_inconsistent, expression cluster_cgroup_value == 1 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='cluster_cgroup_value', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=cluster_cgroup_value_inconsistent 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-cluster_cgroup_value_inconsistent 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_connectable', labels={}}], alarmTargets 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_cannot_connect_to_leader 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_cannot_connect_to_leader 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_send_percent_over_threshold, expression net_send_percent > 80 and eth_net_bandwidth_mbps > 0 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_send_percent', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2025-09-16 14:03:38.596 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_send_percent_over_threshold 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_sda_ioawait, expression io_await >= 200 and io_util >= 99 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_sda_ioawait 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for refresh_location_cache_failed_by_metric, expression location_cache_log_count > 0 and location_cache_success_count == 0 and location_cache_sql_success_count == 0 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_location_cache_log_count', labels={}}, Metric{name='ob_cluster_location_cache_success_count', labels={}}, Metric{name='ob_cluster_location_cache_sql_success_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=refresh_location_cache_failed_by_metric 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-refresh_location_cache_failed_by_metric 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_compaction_status_is_suspend, expression tenant_compaction_status == 1 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='tenant_compaction_status', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_compaction_status_is_suspend 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_compaction_status_is_suspend 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_nvme_ioawait, expression io_await > 20 and io_util >= 98 and io_qusize >= 20 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_nvme_ioawait 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ic_server_connect_failed, expression ic_server_health == 0 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ic_server_health', labels={}}], alarmTargets 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ic_server_connect_failed 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_failed, expression ob_cluster_sync == 0 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_failed 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_process_dead, expression oblb_process_exists == 0 or oblb_service_connectable == 0 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_process_exists', labels={}}, Metric{name='oblb_service_connectable', labels={}}], alarmTargets 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_process_dead 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_process_dead 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_error, expression net_traffic_err_count > 100 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_traffic_err_count', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_error 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 95 2025-09-16 14:03:38.597 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 85 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_memstore_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_memstore_percent_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_node_status_abnormal, expression binlog_node_available == 0 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_node_available', labels={}}], alarmTargets 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_node_status_abnormal 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_node_status_abnormal 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_nic_usage_over_threshold, expression oblb_net_traffic_usage > 80 and net_bandwidth_mbps > 0 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_net_traffic_usage', labels={}}, Metric{name='net_bandwidth_mbps', labels={}}], alarmTargets 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_nic_usage_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_nic_usage_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_ip_forward_invalid, expression oblb_ip_forward_status != 1 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_ip_forward_status', labels={}}], alarmTargets 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_ip_forward_invalid 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_ip_forward_invalid 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for arbitration_service_unavailable, expression arbitration_service_available == 0 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_service_available', labels={}}], alarmTargets 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=arbitration_service_unavailable 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-arbitration_service_unavailable 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_active_memstore_percent_over_threshold, expression active_memstore_percent > 110 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_active_memstore_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_active_memstore_percent_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_conversion_delay, expression binlog_conversion_delay > 10000 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_conversion_delay', labels={}}], alarmTargets 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_conversion_delay 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_conversion_delay 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obagent_dead, expression host_agent_process_status == 0 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_process_status', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obagent_dead 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_memory_usage_over_threshold, expression binlog_host_memory_usage > 90 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_memory_usage', labels={}}], alarmTargets 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_memory_usage_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_memory_usage_over_threshold 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for monagent_process_stop, expression monagent_boot_time_delta_seconds > 10 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monagent_boot_time_delta_seconds', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monagent_process_stop 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monagent_process_stop 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for mgragent_process_stop, expression mgragent_boot_time_delta_seconds > 10 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='mgragent_boot_time_delta_seconds', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=mgragent_process_stop 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-mgragent_process_stop 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_full, expression eth_net_traffic_usage > 92 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2025-09-16 14:03:38.598 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_full 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_monitordb_disconnected, expression monitordb_connectable == 0 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitordb_connectable', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_monitordb_disconnected 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_monitordb_disconnected 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_stop, expression obproxyd_boot_time_delta_seconds > 10 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_boot_time_delta_seconds', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_stop 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_stop 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_storage_usage_over_threshold, expression binlog_host_storage_usage > 90 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_storage_usage', labels={}}], alarmTargets 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_storage_usage_over_threshold 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_storage_usage_over_threshold 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_percent_over_threshold, expression tenant500_mem_hold_percent > 95 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_percent_over_threshold 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for vpc_connect_failed, expression vpc_network_health == 0 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='vpc_network_health', labels={}}], alarmTargets 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-vpc_connect_failed 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_fd_usage, expression observer_fd_usage > 65 and observer_fd_count > 0 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_fd_count', labels={}}, Metric{name='ob_host_observer_fd_usage', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2025-09-16 14:03:38.599 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_fd_usage 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 97 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 85 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_disk_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_sstable_percent_over_threshold 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_absent, expression etcd_leader_count != 1 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_count', labels={}}], alarmTargets 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_absent 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_absent 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_over_threshold, expression tenant500_mem_hold > 100 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_gigabyte', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_over_threshold 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_exists_expired_xa_trans, expression xa_trans_max_duration_seconds > 1200 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_xa_trans_max_duration_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_exists_expired_xa_trans 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for agentd_process_stop, expression agentd_boot_time_delta_seconds > 10 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agentd_boot_time_delta_seconds', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agentd_process_stop 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agentd_process_stop 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_merge, expression no_merge_time > 108000 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_merge_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_merge 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_compaction, expression no_compaction_seconds > 108000 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_compaction_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_compaction 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_overload, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps > 0 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_overload 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 97 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 95 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_mem_percent', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_mem_percent_over_threshold 2025-09-16 14:03:38.600 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_connection_percent_over_threshold, expression ob_connection_percent > 80 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_connection_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_connection_percent_over_threshold 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for observer_process_stop, expression observer_boot_time_delta_seconds > 10 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='observer_boot_time_delta_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=observer_process_stop 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-observer_process_stop 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_stopped, expression ob_server_stopped_duration_seconds > 0 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_stopped_duration_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_stopped 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_stopped 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 100 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 50 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_offset_milliseconds', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_offset_too_large 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_inode_usage, expression file_inode_usage > 80 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_file_inode_usage', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_inode_usage 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_delay_too_long, expression standby_tenant_delay_seconds >= 600 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_delay_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_delay_too_long 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_delay_too_long 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_expired_trans_exist, expression pending_trans_max_duration_seconds > 1200 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_pending_trans_max_duration_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_expired_trans_exist 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_large_trans_exist, expression trans_max_log_size_mb > 102400 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_trans_max_log_size_mb', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_large_trans_exist 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_storage_short_meta_mem_hold_high, expression tenant500_storage_short_meta_hold_percentage > 30 and tenant500_storage_short_meta_hold_gb > 0 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_storage_short_meta_hold_gb', labels={}}, Metric{name='tenant500_storage_short_meta_hold_percentage', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_storage_short_meta_mem_hold_high 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_storage_short_meta_mem_hold_high 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_full, expression cpu_used_percent >= 98 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_used_percent', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2025-09-16 14:03:38.601 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_full 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_switched, expression etcd_leader_switch_count > 0 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_switch_count', labels={}}], alarmTargets 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_switched 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_switched 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_service_not_exist, expression ntp_service_exist == 0 or ntp_service_available == 0 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_service_exist', labels={}}, Metric{name='host_ntp_service_available', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_service_not_exist 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 2 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 1 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_restore_status_code', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_status_error 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_status_error 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_task_timeout, expression ob_server_task_max_duration_seconds > 10800 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_task_max_duration', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_task_timeout 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_sys_abnormal, expression cpu_system > 40 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_system', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_sys_abnormal 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_status_check_failed, expression ob_cluster_status_check == 0 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_status_check', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_status_check_failed 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_invalid_disk_exists, expression ob_disk_invalid_count > 0 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_invalid_disk_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_invalid_disk_exists 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_invalid_disk_exists 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_master_switched, expression keepalived_release_master_count > 0 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_release_master_count', labels={}}], alarmTargets 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_master_switched 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_master_switched 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_exists_inactive_server, expression oblb_inactive_server_count > 0 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_inactive_server_count', labels={}}], alarmTargets 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_exists_inactive_server 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_exists_inactive_server 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_tcp_retrans_percent_over_threshold, expression tcp_retrans_percent > 10 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_tcp_retrans_percent', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_tcp_retrans_percent_over_threshold 2025-09-16 14:03:38.602 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_cpu_percent_over_threshold, expression cpu_percent > 90 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_cpu_percent', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_cpu_percent_over_threshold 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_process_dead, expression obdns_etcd_process_exists == 0 or obdns_etcd_connectable == 0 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_connectable', labels={}}, Metric{name='obdns_etcd_process_exists', labels={}}], alarmTargets 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_process_dead 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_process_dead 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 2 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 1.5 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_load1_per_cpu', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_load1_per_cpu_over_threshold 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_meta_db_disconnected, expression ocp_meta_db_health == 0 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_meta_db_health', labels={}}], alarmTargets 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_meta_db_disconnected 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_meta_db_disconnected 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_cpu_usage_over_threshold, expression binlog_host_cpu_usage > 90 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_cpu_usage', labels={}}], alarmTargets 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_cpu_usage_over_threshold 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_cpu_usage_over_threshold 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_too_many_errors_occur, expression ocp_http_request_error_count >= 1 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_error_count', labels={}}], alarmTargets 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_too_many_errors_occur 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_too_many_errors_occur 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_stop, expression obproxy_boot_time_delta_seconds > 10 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_boot_time_delta_seconds', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_stop 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_stop 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_compaction_error, expression compaction_is_error == 1 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_compaction_error_flag', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_compaction_error 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_dump_error, expression binlog_dump_error_count > 10 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_dump_error_count', labels={}}], alarmTargets 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_dump_error 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_dump_error 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_disk_readonly, expression disk_readonly_flag == 1 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_disk_readonly_flag', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_disk_readonly 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_delay_time_too_long, expression sync_delay_time > 600 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync_delay_time', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_delay_time_too_long 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_timeout, expression ocp_http_request_duration_seconds >= 5 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_duration_seconds', labels={}}], alarmTargets 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_timeout 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_timeout 2025-09-16 14:03:38.603 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_cpu_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_cpu_percent_over_threshold 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_service_inactive, expression keepalived_process_exists == 0 or keepalived_up_status == 0 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_up_status', labels={}}, Metric{name='oblb_keepalived_process_exists', labels={}}], alarmTargets 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_service_inactive 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_service_inactive 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_absent, expression etcd_leader_count != 1 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_count', labels={}}], alarmTargets 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_absent 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_absent 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_data_disk_percent_over_threshold, expression ob_data_disk_usage_percent > 97 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_data_path_disk_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_data_disk_percent_over_threshold 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_become_master, expression keepalived_become_master_count > 0 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_become_master_count', labels={}}], alarmTargets 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_become_master 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_become_master 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for arbitration_group_auto_replace_failed, expression arbitration_group_auto_replace_task_status == 0 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_group_auto_replace_task_status', labels={}}], alarmTargets 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=arbitration_group_auto_replace_failed 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-arbitration_group_auto_replace_failed 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_process_cpu_bind_core_is_invalid, expression host_process_cpu_bind_core_alarm_status == 1 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_process_cpu_bind_core_alarm_status', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_process_cpu_bind_core_is_invalid 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_process_cpu_bind_core_is_invalid 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for agent_process_count_abnormal, expression agent_process_count != 1 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agent_process_count', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agent_process_count_abnormal 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agent_process_count_abnormal 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_disk_usage_high, expression ob_tenant_log_disk_usage > 85 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_disk_usage', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_disk_usage_high 2025-09-16 14:03:38.604 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_service_name_is_invalid, expression ob_tenant_service_name_status == 1 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_service_name_status', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_service_name_is_invalid 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_service_name_is_invalid 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_instance_abnormal, expression binlog_instance_down > 0 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_instance_down', labels={}}], alarmTargets 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_instance_abnormal 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_instance_abnormal 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_process_dead, expression obdns_process_exists == 0 or obdns_service_connectable == 0 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_service_connectable', labels={}}, Metric{name='obdns_process_exists', labels={}}], alarmTargets 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_process_dead 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_process_dead 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_error, expression merge_error_flag == 1 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_error_flag', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_error 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_not_exist, expression observer_process_exists == 0 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_process_exists', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_not_exist 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_open_fd_count_over_threshold, expression host_agent_open_fd_count > 1000 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_open_fd_count', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_open_fd_count_over_threshold 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_timeout_or_interrupted, expression storage_capacity_monitor_error_code == 1002 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_timeout_or_interrupted 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_recv_percent_over_threshold, expression net_recv_percent > 80 and eth_net_bandwidth_mbps > 0 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_recv_percent', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_recv_percent_over_threshold 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_connectable', labels={}}], alarmTargets 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_cannot_connect_to_leader 2025-09-16 14:03:38.605 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_cannot_connect_to_leader 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_collect_metric_failure_rate_high, expression collect_metric_failure_rate > 10 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_collect_metric_failure_rate', labels={}}], alarmTargets 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_collect_metric_failure_rate_high 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_collect_metric_failure_rate_high 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_switched, expression etcd_leader_switch_count > 0 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_switch_count', labels={}}], alarmTargets 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_switched 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_switched 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_dead, expression obproxyd_process_exists == 0 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_process_exists', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_dead 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 97 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 95 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_install_path_disk_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_install_disk_percent_over_threshold 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_frozen, expression no_frozen_time > 90000 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_frozen_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_frozen 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_frozen_version_delta_over_threshold, expression frozen_versions > 1 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_frozen_version_delta', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_frozen_version_delta_over_threshold 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_disk_usage_over_threshold, expression binlog_service_disk_usage > 90 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_service_disk_usage', labels={}}], alarmTargets 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_disk_usage_over_threshold 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_disk_usage_over_threshold 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_core_dump, expression obproxy_core_dump_seconds < 1200 and obproxy_core_dump_seconds > 0 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_core_dump_seconds', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_core_dump 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_core_dump 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_dead, expression obproxy_process_exists == 0 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_process_exists', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_dead 2025-09-16 14:03:38.606 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_root_usage, expression root_disk_usage > 95 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_root_disk_usage', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_root_usage 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_memory_peak, expression obproxy_rss_mem_used_percent > 90 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_rss_mem_used_percent', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_memory_peak 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_memory_peak 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_frozen, expression no_frozen_seconds > 90000 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_frozen_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_frozen 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_core_dump, expression observer_core_dump_seconds < 1200 and observer_core_dump_seconds > 0 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_core_dump_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_core_dump 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_replica_absent, expression tenant_partition_replica_absent_count > 100 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_replica_absent_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_replica_absent 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_replica_absent 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for monitor_exporter_unavaliable, expression monitor_exporter_avaliable == 0 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitor_exporter_avaliable', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monitor_exporter_unavaliable 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for os_kernel_io_hang, expression io_util >= 99 and io_qusize >= 20 and io_read_write_time == 0 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_util', labels={}}, Metric{name='ob_host_io_read_write_time', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_kernel_io_hang 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_client_connections_usage_over_threshold, expression client_connection_used_percent > 85 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_client_connections_usage', labels={}}], alarmTargets C_obproxy_zq-4/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_client_connections_usage_over_threshold 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_client_connections_usage_over_threshold 2025-09-16 14:03:38.607 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_cpu_usage_over_threshold, expression ob_tenant_cpu_percent > 95 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_real_cpu_percent', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_cpu_usage_over_threshold 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_cpu_usage_over_threshold 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_res_memory_over_threshold, expression host_agent_resident_memory_gb > 1.5 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_res_memory', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_res_memory_over_threshold 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_unavailable, expression host_available == 0 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_available', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_unavailable 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_task_timeout, expression ob_tenant_task_max_duration_seconds > 10800 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_task_max_duration', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_task_timeout 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_disk_readonly, expression disk_readonly_flag == 1 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_disk_readonly_flag', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_disk_readonly 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_long_trans_exist, expression long_trans_max_duration_seconds > 1200 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_long_trans_max_duration_seconds', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_long_trans_exist 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_stream_degraded, expression ob_tenant_log_stream_degraded_count > 0 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_stream_degraded_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_stream_degraded 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_stream_degraded 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_goroutine_count_over_threshold, expression host_agent_goroutine_count > 3000 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_goroutine_count', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_goroutine_count_over_threshold 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cannot_connected, expression ob_connectable == 0 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_connectable', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cannot_connected 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_process_dead, expression etcd_process_exists == 0 or oblb_etcd_connectable == 0 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_connectable', labels={}}, Metric{name='oblb_etcd_process_exists', labels={}}], alarmTargets 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_process_dead 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_process_dead 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_inactive_server, expression inactive_server_count > 0 2025-09-16 14:03:38.608 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_inactive_server_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_inactive_server 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_partition_count_over_threshold, expression partition_count > 30000 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_partition_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_partition_count_over_threshold 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_remote_server_time_diff_too_large, expression clock_diff_milliseconds > 50 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_clock_diff_milliseconds', labels={}}], alarmTargets H_192.168.0.104,H_192.168.0.111,H_192.168.0.159,H_192.168.0.46,H_192.168.0.54,H_192.168.0.85 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_remote_server_time_diff_too_large 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 10 and request_queue_time > 1000 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 100 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_request_queue_time_us', labels={}}, Metric{name='ob_tenant_host_request_queue', labels={}}], alarmTargets C_zhengqi-1-PRIMARY/T_cos_PRIMARY,T_sys_PRIMARY,T_vas_ucs_PRIMARY 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_request_queue_over_threshold 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_request_queue_over_threshold 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_index_fail_table, expression index_fail_count > 0 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_index_fail_count', labels={}}], alarmTargets C_zhengqi-1-PRIMARY 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_index_fail_table 2025-09-16 14:03:38.609 INFO 9 --- [ocp-schedules-10,1eaadd3ccb812b24,96d900608166c28b] c.o.o.a.u.f.VersionalProductFactory : refresh done, configCount=133, updatedCount=133, failedToUpdateCount=0 2025-09-16 14:03:38.825 INFO 9 --- [ocp-async-3,045a00a32a5af99d,6cd8ef035c4faa02] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:38.825 WARN 9 --- [ocp-async-2,6caa11c8c74316f4,052f3ece5e6e8d64] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:39.431 INFO 9 --- [ocp-schedules-27,99e68ec543df0bd7,39e6b78fc6bfd063] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:03:39.433 INFO 9 --- [ocp-schedules-27,99e68ec543df0bd7,39e6b78fc6bfd063] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:03:39.648 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:39.649 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:40.004 INFO 9 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=3 2025-09-16 14:03:40.004 INFO 9 --- [ocp-schedules-7,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=3 2025-09-16 14:03:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:03:40.003326+08:00, lastProcessTime=2025-09-16T14:03:30.003417+08:00 2025-09-16 14:03:40.112 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:03:40.003326+08:00 2025-09-16 14:03:40.190 INFO 9 --- [ocp-async-9,8c23fdf4b5b5580b,86e97783531f2ffe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:03:40.269 INFO 9 --- [ocp-schedules-16,b13c1af9b9dcbd70,65224e292144a589] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 14:03:40.269 INFO 9 --- [ocp-schedules-16,b13c1af9b9dcbd70,65224e292144a589] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 14:03:40.272 INFO 9 --- [ocp-schedules-3,a294c7037518521c,4b1a0e7a2676f7d1] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:03:40.272 INFO 9 --- [ocp-schedules-3,a294c7037518521c,4b1a0e7a2676f7d1] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 14:03:40.272 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 14:03:40.272 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 14:03:40.272 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 14:03:40.272 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 14:03:40.276 INFO 9 --- [ocp-schedules-3,a294c7037518521c,4b1a0e7a2676f7d1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:40.276 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:40.276 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:40.276 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:40.276 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:40.276 INFO 9 --- [ocp-schedules-3,a294c7037518521c,4b1a0e7a2676f7d1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:40.277 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:40.277 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:40.277 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:40.277 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:40.285 INFO 9 --- [Collect all tenants major compactions1,b13c1af9b9dcbd70,17e921480c046e89] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 14:03:40.285 INFO 9 --- [Collect all tenants major compactions2,b13c1af9b9dcbd70,34468b49eb2fe42e] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:03:40.286 INFO 9 --- [Collect all tenants major compactions3,b13c1af9b9dcbd70,ab1e6b9011e52fe6] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 14:03:40.291 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 14:03:40.291 INFO 9 --- [ocp-schedules-3,a294c7037518521c,4b1a0e7a2676f7d1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 14:03:40.291 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 14:03:40.291 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 14:03:40.291 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 14:03:40.293 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 14:03:40.296 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:40.297 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:40.303 INFO 9 --- [Collect all tenants major compactions1,b13c1af9b9dcbd70,17e921480c046e89] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:40.303 INFO 9 --- [Collect all tenants major compactions2,b13c1af9b9dcbd70,34468b49eb2fe42e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:40.303 INFO 9 --- [Collect all tenants major compactions3,b13c1af9b9dcbd70,ab1e6b9011e52fe6] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:40.304 INFO 9 --- [Collect all tenants major compactions2,b13c1af9b9dcbd70,34468b49eb2fe42e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 14:03:40.304 INFO 9 --- [Collect all tenants major compactions1,b13c1af9b9dcbd70,17e921480c046e89] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 14:03:40.305 INFO 9 --- [Collect all tenants major compactions3,b13c1af9b9dcbd70,ab1e6b9011e52fe6] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 14:03:40.309 INFO 9 --- [Collect all tenants major compactions1,b13c1af9b9dcbd70,17e921480c046e89] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:03:40.309 INFO 9 --- [Collect all tenants major compactions3,b13c1af9b9dcbd70,ab1e6b9011e52fe6] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:03:40.310 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 14:03:40.312 INFO 9 --- [Collect all tenants major compactions2,b13c1af9b9dcbd70,34468b49eb2fe42e] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:03:40.312 INFO 9 --- [ocp-schedules-3,a294c7037518521c,4b1a0e7a2676f7d1] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 14:03:40.313 INFO 9 --- [ocp-schedules-16,b13c1af9b9dcbd70,65224e292144a589] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 14:03:40.636 INFO 9 --- [prometheus-minute-schedule-1,f1c93ef361135ad4,3cc8da2ca8f102eb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:40.639 INFO 9 --- [prometheus-minute-schedule-1,f1c93ef361135ad4,3cc8da2ca8f102eb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:40.825 WARN 9 --- [ocp-async-8,f08874f81c00e066,dfcea5839bb6dc8a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:40.825 INFO 9 --- [ocp-async-6,46851ef6b92cf336,921168896e3e787d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:41.861 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2025-09-16T13:59:41.504, end=2025-09-16T14:01:41.859} 2025-09-16 14:03:41.864 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbit 2025-09-16 14:03:41.864 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 14:03:41.866 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:59:41.504, end=2025-09-16T14:01:41.859},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 14:03:41.866 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 14:03:41.866 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 14:03:41.871 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 14:03:41.876 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 7 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:59:41.504, end=2025-09-16T14:01:41.859},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 14:03:41.885 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null) 2025-09-16 14:03:41.885 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 14:03:41.894 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql plan 2025-09-16 14:03:41.896 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : PERFORMANCE_DEGRADATION_AFTER_PLAN_CHANGED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:59:41.504, end=2025-09-16T14:01:41.859},PlanChangePerfDegradationDetectService.Config(enabled=true, sysTenantEnabled=true, level=0, compareMin=5, cpuTimeMultiply={0=50.0, 1=20.0, 10=10.0, 100=3.0, 1000=2.0}, limit=2000, cpuTimeLimitMs=1.0, alarm=true, autoFlushPlanCache=false, minElapsedTimeMsForFlushingPlanCache=50.0) 2025-09-16 14:03:41.896 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : Found out 0 dubious sqls of Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null) 2025-09-16 14:03:41.896 INFO 9 --- [pool-16-thread-1,,] i.PlanChangePerfDegradationDetectService : diagnose sql stats 2025-09-16 14:03:41.900 INFO 9 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2025-09-16 14:03:42.334 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,6f264ac7dbd50ac2,1e44cfb772ccc6f1] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=6f264ac7dbd50ac2, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:03:42.334 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,6f264ac7dbd50ac2,1e44cfb772ccc6f1] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=6f264ac7dbd50ac2, duration=1 ms] 2025-09-16 14:03:42.335 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,e9c003bf88062dc6,40e95becb7c46266] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=e9c003bf88062dc6, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:03:42.335 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,e9c003bf88062dc6,40e95becb7c46266] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=e9c003bf88062dc6, duration=0 ms] 2025-09-16 14:03:42.649 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:42.649 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:42.818 INFO 9 --- [ocp-schedules-8,224ea9131b85495e,0919c68f5ce95106] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:03:42.823 WARN 9 --- [scanner-1392478-1,224ea9131b85495e,6f3f1c51c9a31268] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:03:42.825 WARN 9 --- [ocp-async-1,92db2f413cf331dd,6e8f4821c6bcb5de] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:42.825 INFO 9 --- [ocp-async-7,1c26aa69ef0c226d,0903f0c15f069aba] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:42.830 INFO 9 --- [alarm-detect-11,224ea9131b85495e,9aa6251f691540eb] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:03:42.833 INFO 9 --- [alarm-detect-4,224ea9131b85495e,f0a670768b5fe5ab] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:03:42.833 INFO 9 --- [alarm-detect-17,224ea9131b85495e,328bd0061837d8f6] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:03:42.834 WARN 9 --- [alarm-detect-8,224ea9131b85495e,6ee891b8cd2b1f40] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:03:42.834 WARN 9 --- [alarm-detect-8,224ea9131b85495e,6ee891b8cd2b1f40] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:03:42.838 INFO 9 --- [ocp-schedules-19,83e2037487171b6c,83dc97cf95f474b1] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 14:03:42.838 INFO 9 --- [ocp-schedules-19,83e2037487171b6c,83dc97cf95f474b1] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 14:03:42.841 INFO 9 --- [alarm-detect-8,224ea9131b85495e,1aa38d863007eb66] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:03:42.875 INFO 9 --- [ocp-schedules-19,83e2037487171b6c,83dc97cf95f474b1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:42.876 INFO 9 --- [ocp-schedules-19,83e2037487171b6c,83dc97cf95f474b1] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 14:03:43.636 INFO 9 --- [prometheus-minute-schedule-1,fd3f6104fddbbd9b,de1825728e4b141c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:43.639 INFO 9 --- [prometheus-minute-schedule-1,fd3f6104fddbbd9b,de1825728e4b141c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:44.825 WARN 9 --- [ocp-async-4,18888dac495cd7dd,c35f68904165ac69] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:44.825 INFO 9 --- [ocp-async-3,1e9561ac113e329b,5cfe993ad36fbfe0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:44.956 INFO 9 --- [ocp-schedules-25,1dfba82bbc64ac49,947d2200e1b57fe6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:03:45.649 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:45.650 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:46.636 INFO 9 --- [prometheus-minute-schedule-1,15b67b56ac23ebf3,146cd9a6084cdf5c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:46.639 INFO 9 --- [prometheus-minute-schedule-1,15b67b56ac23ebf3,146cd9a6084cdf5c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:46.825 WARN 9 --- [ocp-async-10,59d591f4cc79d8ff,d740ae6cf51f940a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:46.825 INFO 9 --- [ocp-async-8,bd12a8de4d949429,3385c904be62071c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:47.886 INFO 9 --- [ocp-schedules-23,000968a0bac67408,e16355e8ef7d85c5] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 14:03:47.887 INFO 9 --- [ocp-schedules-23,000968a0bac67408,e16355e8ef7d85c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:47.929 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:03:47.929 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:47.932 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:03:47.955 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:47.956 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:03:47.979 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:47.980 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:03:48.002 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.003 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:03:48.007 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.008 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:03:48.032 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.032 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:03:48.055 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.056 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:03:48.059 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.059 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:03:48.082 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.083 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:03:48.106 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.107 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:03:48.125 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.126 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 14:03:48.127 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.128 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:03:48.129 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.129 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:03:48.130 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.131 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 14:03:48.132 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.132 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:03:48.133 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.134 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:03:48.151 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.152 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 14:03:48.152 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.153 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:03:48.154 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.154 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:03:48.170 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 14:03:48.171 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 14:03:48.196 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:03:48.197 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:48.197 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 14:03:48.224 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:03:48.224 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 14:03:48.224 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:03:48.224 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 14:03:48.224 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:03:48.224 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 14:03:48.226 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 14:03:48.226 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:03:48.226 INFO 9 --- [ocp-schedules-23,000968a0bac67408,e16355e8ef7d85c5] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 14:03:48.650 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:48.651 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:48.825 WARN 9 --- [ocp-async-6,5e7a0bce6edb33de,2ec6642c835be18d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:48.825 INFO 9 --- [ocp-async-1,85c6c064e0d36235,110fa164a4f4acf8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 14:03:49,042 |-INFO in ReconfigureOnChangeTask(born:1758002509042) - Empty watch file list. Disabling 2025-09-16 14:03:49.441 INFO 9 --- [ocp-schedules-2,2c27fdfa2a18ad13,f12cb5b15f4f88b4] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:03:49.443 INFO 9 --- [ocp-schedules-2,2c27fdfa2a18ad13,f12cb5b15f4f88b4] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:03:49.636 INFO 9 --- [prometheus-minute-schedule-1,7c403f8278364f6a,4d7fcda288dd638a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:49.639 INFO 9 --- [prometheus-minute-schedule-1,7c403f8278364f6a,4d7fcda288dd638a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:03:50.003127+08:00, lastProcessTime=2025-09-16T14:03:40.003326+08:00 2025-09-16 14:03:50.115 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:03:50.003127+08:00 2025-09-16 14:03:50.190 INFO 9 --- [ocp-async-3,4144069a5bd93f51,4a3cbe7371f2876b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:03:50.825 WARN 9 --- [ocp-async-4,071082ae3801d88d,0a3b33cdbe638374] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:50.825 INFO 9 --- [ocp-async-3,844327d5799f2ab2,124fd12ab790178c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:51.651 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:51.652 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:52.636 INFO 9 --- [prometheus-minute-schedule-1,45afa8cc8c6b2a03,be8909ca976756ae] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:52.639 INFO 9 --- [prometheus-minute-schedule-1,45afa8cc8c6b2a03,be8909ca976756ae] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:52.731 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,55f27ab75bfc1227,3e4398fb7e322070] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=55f27ab75bfc1227, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:03:52.731 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,55f27ab75bfc1227,3e4398fb7e322070] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=55f27ab75bfc1227, duration=1 ms] 2025-09-16 14:03:52.732 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,658f9f3b1efa2ed1,bc3993e1245399a8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=658f9f3b1efa2ed1, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:03:52.733 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,658f9f3b1efa2ed1,bc3993e1245399a8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=658f9f3b1efa2ed1, duration=1 ms] 2025-09-16 14:03:52.825 WARN 9 --- [ocp-async-10,8dcf992f2a6da382,5e8ccbba58848dd7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:52.825 INFO 9 --- [ocp-async-9,47665621632a107d,48b48895a83b07cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:52.868 INFO 9 --- [ocp-schedules-5,719821a4c4167a8e,3fe95b15fc20be65] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:03:52.873 WARN 9 --- [scanner-1392652-1,719821a4c4167a8e,fafb6c348d4ff4d6] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:03:52.886 WARN 9 --- [alarm-detect-10,719821a4c4167a8e,31f027cf95e2eee8] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:03:52.886 WARN 9 --- [alarm-detect-10,719821a4c4167a8e,31f027cf95e2eee8] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:03:53.308 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,63ca7aea00811265,289b98248435734e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=63ca7aea00811265, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 14:03:53.308 INFO 9 --- [http-nio-0.0.0.0-8080-exec-3,63ca7aea00811265,289b98248435734e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=63ca7aea00811265, duration=1 ms] 2025-09-16 14:03:54.652 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:54.653 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:54.826 WARN 9 --- [ocp-async-6,8758ebc364665ffa,b38172e909113b2c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:54.826 INFO 9 --- [ocp-async-2,79c28f647d55ef9b,6c89033ef4337d86] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:54.838 INFO 9 --- [ocp-schedules-28,d8e7049f995b459b,78fa1fa27962f8b6] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:03:54.842 INFO 9 --- [ocp-schedules-28,d8e7049f995b459b,78fa1fa27962f8b6] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:03:54.842 INFO 9 --- [ocp-schedules-28,d8e7049f995b459b,78fa1fa27962f8b6] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:03:54.959 INFO 9 --- [ocp-schedules-15,a379d3a55d1b2366,8c6a4915dd4de994] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:03:55.636 INFO 9 --- [prometheus-minute-schedule-1,856c727585724404,e564c4341b580b00] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:55.639 INFO 9 --- [prometheus-minute-schedule-1,856c727585724404,e564c4341b580b00] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:56.826 WARN 9 --- [ocp-async-2,b5e46c71182e8d4b,3bb4a5f4fc5a9d25] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:56.826 INFO 9 --- [ocp-async-4,93cc77b67e59ab34,a07e4abd36f00441] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:57.653 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:03:57.654 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:03:58.636 INFO 9 --- [prometheus-minute-schedule-1,3847439915211bd8,aad1b9c619e8cdac] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002640, interval=60 2025-09-16 14:03:58.639 INFO 9 --- [prometheus-minute-schedule-1,3847439915211bd8,aad1b9c619e8cdac] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:03:58.826 WARN 9 --- [ocp-async-4,142a2a16b6de4e8e,437300e3c9346d1e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:03:58.826 INFO 9 --- [ocp-async-8,009d175991447493,d0571ee51e8c30be] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:03:59.448 INFO 9 --- [ocp-schedules-24,26b45b70c875a663,52f87de68debddec] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:03:59.450 INFO 9 --- [ocp-schedules-24,26b45b70c875a663,52f87de68debddec] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:03:59.938 INFO 9 --- [ocp-schedules-29,1553e2979a7ace89,c6424039aa17ba6b] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:03:59.941 INFO 9 --- [ocp-schedules-7,6e8d60d0c6aedad1,92ebe6f6b3213f7b] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:03:59.941 INFO 9 --- [ocp-schedules-2,07c2eac15fa9faec,af04456f4a00bd9c] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:03:59.942 INFO 9 --- [ocp-schedules-18,d57ec8b0a3640ee7,e156ca7f587b932d] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:03:59.943 INFO 9 --- [ocp-schedules-2,07c2eac15fa9faec,af04456f4a00bd9c] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:59.943 INFO 9 --- [ocp-schedules-7,6e8d60d0c6aedad1,92ebe6f6b3213f7b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:59.943 INFO 9 --- [ocp-schedules-18,d57ec8b0a3640ee7,e156ca7f587b932d] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:03:59.943 INFO 9 --- [ocp-schedules-18,d57ec8b0a3640ee7,e156ca7f587b932d] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:03:59.944 INFO 9 --- [ocp-schedules-28,3506e73081a72fe6,f58bd4565c7fe497] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:03:59.944 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:03:59.944 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:03:59.944 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:03:59.944 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:03:59.945 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:03:59.945 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:03:59.945 INFO 9 --- [ocp-schedules-4,e4744a792268be2b,73d220b3dd87f534] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:03:59.945 INFO 9 --- [host-check-clockdiff1,e4744a792268be2b,a146299ef9abaf54] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:03:59.946 INFO 9 --- [host-check-clockdiff2,e4744a792268be2b,9c5d457bb5b9c7e8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:03:59.946 INFO 9 --- [host-check-clockdiff3,e4744a792268be2b,d19f6c2f749b8c27] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:03:59.946 INFO 9 --- [host-check-clockdiff4,e4744a792268be2b,e6718dc02e258671] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:03:59.946 INFO 9 --- [host-check-clockdiff5,e4744a792268be2b,9c15d8dd7303050a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:03:59.946 INFO 9 --- [ocp-schedules-23,aa066809a3be1db8,387ad5c9d95d7b22] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:03:59.946 INFO 9 --- [host-check-clockdiff6,e4744a792268be2b,970c49eaa2d6d816] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:03:59.946 INFO 9 --- [host-check-agent-status1,aa066809a3be1db8,73e4135f65b746e6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:03:59.946 INFO 9 --- [host-check-agent-status2,aa066809a3be1db8,a4fa07b50abdaf99] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:03:59.946 INFO 9 --- [host-check-agent-status3,aa066809a3be1db8,fcc1648e9bfd71f2] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:03:59.946 INFO 9 --- [host-check-agent-status4,aa066809a3be1db8,bd0d0149a97cd7e9] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:03:59.946 INFO 9 --- [host-check-agent-status5,aa066809a3be1db8,297876359d0185f1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:03:59.946 INFO 9 --- [host-check-agent-status6,aa066809a3be1db8,da19718ee67b077c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:03:59.947 INFO 9 --- [ocp-schedules-11,45b1093386eec1b8,878bb6257c24c9cc] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:03:59.951 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:59.953 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:59.953 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:59.953 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:59.953 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:59.953 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:59.953 INFO 9 --- [host-check-clockdiff5,e4744a792268be2b,9c15d8dd7303050a] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002639 -1 -1 , error= 2025-09-16 14:03:59.953 INFO 9 --- [host-check-clockdiff3,e4744a792268be2b,d19f6c2f749b8c27] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002639 -1 -1 , error= 2025-09-16 14:03:59.953 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:59.953 INFO 9 --- [host-check-clockdiff2,e4744a792268be2b,9c5d457bb5b9c7e8] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002639 -1 -1 , error= 2025-09-16 14:03:59.953 INFO 9 --- [host-check-clockdiff4,e4744a792268be2b,e6718dc02e258671] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002639 -1 -1 , error= 2025-09-16 14:03:59.953 INFO 9 --- [host-check-clockdiff1,e4744a792268be2b,a146299ef9abaf54] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002639 -1 -1 , error= 2025-09-16 14:03:59.953 INFO 9 --- [host-check-clockdiff6,e4744a792268be2b,970c49eaa2d6d816] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002639 -1 -1 , error= 2025-09-16 14:03:59.955 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:59.955 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:59.955 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:59.955 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:59.955 INFO 9 --- [host-check-agent-status6,aa066809a3be1db8,da19718ee67b077c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:59.955 INFO 9 --- [host-check-agent-status5,aa066809a3be1db8,297876359d0185f1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:59.955 INFO 9 --- [host-check-agent-status1,aa066809a3be1db8,73e4135f65b746e6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:59.955 INFO 9 --- [host-check-agent-status4,aa066809a3be1db8,bd0d0149a97cd7e9] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:59.955 INFO 9 --- [host-check-agent-status2,aa066809a3be1db8,a4fa07b50abdaf99] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:59.955 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:59.956 INFO 9 --- [host-check-agent-status3,aa066809a3be1db8,fcc1648e9bfd71f2] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:59.956 INFO 9 --- [host-check-agent-status4,aa066809a3be1db8,bd0d0149a97cd7e9] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:59.956 INFO 9 --- [host-check-agent-status1,aa066809a3be1db8,73e4135f65b746e6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:59.956 INFO 9 --- [host-check-agent-status5,aa066809a3be1db8,297876359d0185f1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:59.956 INFO 9 --- [host-check-agent-status2,aa066809a3be1db8,a4fa07b50abdaf99] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:59.956 INFO 9 --- [host-check-agent-status6,aa066809a3be1db8,da19718ee67b077c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:59.957 INFO 9 --- [host-check-agent-status3,aa066809a3be1db8,fcc1648e9bfd71f2] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:59.970 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:03:59.970 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:03:59.970 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:03:59.970 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:03:59.970 INFO 9 --- [host-check-agent-status1,aa066809a3be1db8,73e4135f65b746e6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:03:59.970 INFO 9 --- [host-check-agent-status4,aa066809a3be1db8,bd0d0149a97cd7e9] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:03:59.971 INFO 9 --- [host-check-agent-status3,aa066809a3be1db8,fcc1648e9bfd71f2] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:03:59.971 INFO 9 --- [host-check-agent-status5,aa066809a3be1db8,297876359d0185f1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:03:59.971 INFO 9 --- [host-check-agent-status6,aa066809a3be1db8,da19718ee67b077c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:03:59.971 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:03:59.971 INFO 9 --- [host-check-agent-status2,aa066809a3be1db8,a4fa07b50abdaf99] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:03:59.970724802+08:00 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:03:59.970630698+08:00 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:03:59.971066734+08:00 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:03:59.970812826+08:00 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:03:59.972+08:00 2025-09-16 14:03:59.972 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:03:59.972+08:00 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:03:59.972+08:00 2025-09-16 14:03:59.972 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:03:59.972+08:00 2025-09-16 14:03:59.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:03:59.973 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:03:59.972386896+08:00 2025-09-16 14:03:59.973 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:03:59.972249998+08:00 2025-09-16 14:03:59.974 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:03:59.973+08:00 2025-09-16 14:03:59.974 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:03:59.973+08:00 2025-09-16 14:03:59.974 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:03:59.972+08:00 and status AVAILABLE 2025-09-16 14:03:59.974 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:03:59.972+08:00 and status AVAILABLE 2025-09-16 14:03:59.974 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:03:59.972+08:00 and status AVAILABLE 2025-09-16 14:03:59.974 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:03:59.972+08:00 and status AVAILABLE 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status5,aa066809a3be1db8,297876359d0185f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status5,aa066809a3be1db8,297876359d0185f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status5,aa066809a3be1db8,297876359d0185f1] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status1,aa066809a3be1db8,73e4135f65b746e6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status1,aa066809a3be1db8,73e4135f65b746e6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status3,aa066809a3be1db8,fcc1648e9bfd71f2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status1,aa066809a3be1db8,73e4135f65b746e6] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status3,aa066809a3be1db8,fcc1648e9bfd71f2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status3,aa066809a3be1db8,fcc1648e9bfd71f2] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status4,aa066809a3be1db8,bd0d0149a97cd7e9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status4,aa066809a3be1db8,bd0d0149a97cd7e9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:03:59.975 INFO 9 --- [host-check-agent-status4,aa066809a3be1db8,bd0d0149a97cd7e9] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:03:59.975 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:03:59.973+08:00 and status AVAILABLE 2025-09-16 14:03:59.976 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:03:59.973+08:00 and status AVAILABLE 2025-09-16 14:03:59.976 INFO 9 --- [host-check-agent-status2,aa066809a3be1db8,a4fa07b50abdaf99] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:03:59.976 INFO 9 --- [host-check-agent-status2,aa066809a3be1db8,a4fa07b50abdaf99] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:03:59.976 INFO 9 --- [host-check-agent-status2,aa066809a3be1db8,a4fa07b50abdaf99] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:03:59.977 INFO 9 --- [host-check-agent-status6,aa066809a3be1db8,da19718ee67b077c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:03:59.977 INFO 9 --- [host-check-agent-status6,aa066809a3be1db8,da19718ee67b077c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:03:59.977 INFO 9 --- [host-check-agent-status6,aa066809a3be1db8,da19718ee67b077c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:03:59.977 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:03:59.977 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:03:59.978 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:03:59.978 INFO 9 --- [ocp-schedules-2,07c2eac15fa9faec,af04456f4a00bd9c] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:03:59.979 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:03:59.979 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:03:59.979 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:03:59.979 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:03:59.983 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:03:59.983 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:03:59.984 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:03:59.984 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:03:59.984 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:03:59.985 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:03:59.985 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:03:59.985 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:03:59.985 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:03:59.985 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:03:59.986 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:03:59.986 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:03:59.987 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:03:59.988 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:03:59.998 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:59.998 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:59.999 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:59.999 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:59.999 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:03:59.999 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:04:00.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:04:00.002994+08:00, lastProcessTime=2025-09-16T14:03:50.003127+08:00 2025-09-16 14:04:00.026 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:04:00.026 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:04:00.026 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:04:00.027 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:04:00.027 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:00.027 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:04:00.028 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:00.029 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:04:00.029 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:04:00.033 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:04:00.033 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:04:00.033 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:04:00.033 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:04:00.034 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:04:00.036 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:04:00.045 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:00.046 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:00.047 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:00.047 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:00.047 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:00.047 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:00.063 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:00.065 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:00.065 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:04:00.070 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:00.072 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:04:00.074 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:00.074 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:04:00.074 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:04:00.074 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:04:00.074 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:04:00.076 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:04:00.077 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:04:00.081 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:04:00.081 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:04:00.082 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:04:00.082 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:04:00.083 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:04:00.083 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:04:00.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:00.093 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:00.096 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:00.096 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:00.096 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:00.097 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:00.097 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:00.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:00.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:00.120 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:04:00.122 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:04:00.124 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:04:00.124 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:04:00.126 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:04:00.127 INFO 9 --- [host-check-host-status1,3506e73081a72fe6,dc03fd4f5f94b7bb] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:04:00.130 INFO 9 --- [host-check-host-status5,3506e73081a72fe6,709e842cc363ed78] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:04:00.130 INFO 9 --- [host-check-host-status2,3506e73081a72fe6,7a1e2d19be3bdbd3] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:04:00.130 INFO 9 --- [host-check-host-status3,3506e73081a72fe6,2bd15f5b9d590149] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:04:00.131 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:04:00.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:04:00.002994+08:00 2025-09-16 14:04:00.132 INFO 9 --- [host-check-host-status4,3506e73081a72fe6,428e4e9892f9d0d1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:04:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:00.138 INFO 9 --- [host-check-host-status6,3506e73081a72fe6,779004567e14e8db] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:04:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.164 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:00.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.178 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:00.191 INFO 9 --- [ocp-async-2,1702728fbf4598aa,e8c89ee52aa97389] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:04:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.193 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:00.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.207 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:00.223 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:00.237 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:00.239 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:00.240 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:00.245 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:04:00.248 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:04:00.250 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:00.251 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:00.264 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:04:00.326 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:04:00.340 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:00.345 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:00.346 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:04:00.360 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:04:00.360 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:04:00.360 INFO 9 --- [ocp-schedules-7,6e8d60d0c6aedad1,92ebe6f6b3213f7b] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:04:00.654 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:00.654 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:00.826 WARN 9 --- [ocp-async-6,5ee977e15739375e,3628c239447719bd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:00.826 INFO 9 --- [ocp-async-9,df2bc36a8cbc95f2,7474c69260d1b388] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:00.885 INFO 9 --- [ocp-schedules-11,c973412e7499195d,0c4c083da76e4db2] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:04:01.023 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,df74a56c917a38cc,10b68080040e2253] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=df74a56c917a38cc, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:04:01.024 INFO 9 --- [http-nio-0.0.0.0-8080-exec-2,df74a56c917a38cc,10b68080040e2253] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=df74a56c917a38cc, duration=1 ms] 2025-09-16 14:04:01.025 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,bdad65958470805b,0ba981b0d449624f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=bdad65958470805b, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:04:01.025 INFO 9 --- [http-nio-0.0.0.0-8080-exec-8,bdad65958470805b,0ba981b0d449624f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=bdad65958470805b, duration=0 ms] 2025-09-16 14:04:01.636 INFO 9 --- [prometheus-minute-schedule-1,aff320bb711d34b7,1fe40f51e31df653] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:01.639 INFO 9 --- [prometheus-minute-schedule-1,aff320bb711d34b7,1fe40f51e31df653] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:02.826 WARN 9 --- [ocp-async-5,35dd2d78d91361c3,307a856c184d219d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:02.826 INFO 9 --- [ocp-async-7,2e3c4199de676534,3c8a1ec2b4434534] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:02.895 INFO 9 --- [ocp-schedules-10,8e67fd5f012ccb5c,9f0b4dd0efcc54c3] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:04:02.901 WARN 9 --- [scanner-1392782-1,8e67fd5f012ccb5c,d8f9b3331fcf4600] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:04:02.932 INFO 9 --- [alarm-detect-13,8e67fd5f012ccb5c,e43124aed3cf6cc7] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:04:02.932 INFO 9 --- [alarm-detect-3,8e67fd5f012ccb5c,94ae441665733ce9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:04:02.932 INFO 9 --- [alarm-detect-6,8e67fd5f012ccb5c,59f3aac70f1a67af] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:04:02.937 WARN 9 --- [alarm-detect-8,8e67fd5f012ccb5c,24cf374b5e287126] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:04:02.937 WARN 9 --- [alarm-detect-8,8e67fd5f012ccb5c,24cf374b5e287126] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:04:02.946 INFO 9 --- [alarm-detect-17,8e67fd5f012ccb5c,12072e2f90bd872c] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:04:03.654 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:03.655 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:04.636 INFO 9 --- [prometheus-minute-schedule-1,0aca7d6a681c6e33,ca5cb7fdd2e0b4fb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:04.639 INFO 9 --- [prometheus-minute-schedule-1,0aca7d6a681c6e33,ca5cb7fdd2e0b4fb] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:04.826 WARN 9 --- [ocp-async-10,295e2002703f12ee,f55b051564b39cb3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:04.826 INFO 9 --- [ocp-async-3,61153f3a4b1f478a,f4f005f25e521312] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:04.963 INFO 9 --- [ocp-schedules-7,5676b686614f3324,467af848fce1f3c5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:04:06.655 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:06.656 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:06.826 INFO 9 --- [ocp-async-6,39d27511eceec735,b70664d87a6da66c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:06.826 WARN 9 --- [ocp-async-1,7533e324b5fdf348,3ffe139549e25a16] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:07.636 INFO 9 --- [prometheus-minute-schedule-1,ce1d2e9e75ba5270,378fd5b643d594a1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:07.639 INFO 9 --- [prometheus-minute-schedule-1,ce1d2e9e75ba5270,378fd5b643d594a1] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:08.826 WARN 9 --- [ocp-async-9,c0d2330c951fda29,1d6767a212026e6e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:08.826 INFO 9 --- [ocp-async-5,b59a1bab8cf4100c,1704e4a94b34198d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:09.455 INFO 9 --- [ocp-schedules-25,d999fb18b5703616,8d5dcbc02fee2a35] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:04:09.457 INFO 9 --- [ocp-schedules-25,d999fb18b5703616,8d5dcbc02fee2a35] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:04:09.656 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:09.657 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:10.004 INFO 9 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=3 2025-09-16 14:04:10.005 INFO 9 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=3 2025-09-16 14:04:10.007 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:04:10.004906+08:00, lastProcessTime=2025-09-16T14:04:00.002994+08:00 2025-09-16 14:04:10.119 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:04:10.004906+08:00 2025-09-16 14:04:10.191 INFO 9 --- [ocp-async-1,f0c5aedd600c33bb,3233b880213d2527] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:04:10.296 INFO 9 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 13, ruleSize = 13. 2025-09-16 14:04:10.636 INFO 9 --- [prometheus-minute-schedule-1,974ef110d8e78adc,19ddeb1b23e094a6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:10.639 INFO 9 --- [prometheus-minute-schedule-1,974ef110d8e78adc,19ddeb1b23e094a6] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:10.827 WARN 9 --- [ocp-async-3,c96fc74a29e19df3,15a221aa8ca462c9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:10.827 INFO 9 --- [ocp-async-7,0b5851ec796856c6,15318b7a4aa08dee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:11.780 INFO 9 --- [metric-archive-async-2,,] c.o.o.m.service.OcpMetricArchiveService : async type metric archive, timestamp=1758002580, nodeCount=460, affectRows=460 2025-09-16 14:04:12.657 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:12.658 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:12.827 WARN 9 --- [ocp-async-6,903c5ebbbe585a08,88f71e420616e7ef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:12.827 INFO 9 --- [ocp-async-8,58a6fad8e29e124b,eef6c645e9a4c3db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:12.949 INFO 9 --- [ocp-schedules-30,572dc241bee61a36,b43e05ff86e5bee7] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:04:12.953 WARN 9 --- [scanner-1393819-1,572dc241bee61a36,50d50d36067f4756] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:04:12.967 WARN 9 --- [alarm-detect-13,572dc241bee61a36,c134049a8bbefbc5] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:04:12.967 WARN 9 --- [alarm-detect-13,572dc241bee61a36,c134049a8bbefbc5] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:04:13.453 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002580, nodeCount=1000, affectRows=1000 2025-09-16 14:04:13.456 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002580, nodeCount=1000, validCount=996 2025-09-16 14:04:13.481 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002580, nodeCount=1000, affectRows=1000 2025-09-16 14:04:13.483 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002580, nodeCount=1000, validCount=998 2025-09-16 14:04:13.494 ERROR 9 --- [metric-archive-second-2,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; (conn=3221697862) Duplicate entry '824401952415072256-1758002520' for key 'PRIMARY'; nested exception is java.sql.BatchUpdateException: (conn=3221697862) Duplicate entry '824401952415072256-1758002520' for key 'PRIMARY' 2025-09-16 14:04:13.636 INFO 9 --- [prometheus-minute-schedule-1,d6b5f116b6206f36,91426548c429af58] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:13.639 INFO 9 --- [prometheus-minute-schedule-1,d6b5f116b6206f36,91426548c429af58] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:14.229 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002580, nodeCount=855, affectRows=855 2025-09-16 14:04:14.231 INFO 9 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002580, nodeCount=855, validCount=853 2025-09-16 14:04:14.823 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1758002580, nodeCount=1000, affectRows=1000 2025-09-16 14:04:14.825 INFO 9 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1758002580, nodeCount=991, validCount=945 2025-09-16 14:04:14.827 INFO 9 --- [ocp-async-2,9a4726f047159d23,865fe055d9da3fdb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:14.827 WARN 9 --- [ocp-async-5,ff022fe9e06a899e,0b46cfe3c58f2345] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:14.844 INFO 9 --- [ocp-schedules-27,33829bb837fa7566,38d7fd3cc11139b4] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:04:14.848 INFO 9 --- [ocp-schedules-27,33829bb837fa7566,38d7fd3cc11139b4] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:04:14.848 INFO 9 --- [ocp-schedules-27,33829bb837fa7566,38d7fd3cc11139b4] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:04:14.966 INFO 9 --- [ocp-schedules-29,da21204cdf82699c,840f79788289e9f2] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:04:15.658 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:15.659 INFO 9 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:16.636 INFO 9 --- [prometheus-minute-schedule-1,c6a180694619710c,bdf5247d74b28826] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:16.639 INFO 9 --- [prometheus-minute-schedule-1,c6a180694619710c,bdf5247d74b28826] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:16.827 INFO 9 --- [ocp-async-4,c9a1dd8718f133ea,7a0c09f4fd41c535] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:16.827 WARN 9 --- [ocp-async-10,e9d1b83e1fbcc0a5,25645b637edb3719] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:18.659 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:18.659 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:18.827 INFO 9 --- [ocp-async-6,2dd1606c390d533a,9848ca2e7952dc83] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:18.827 WARN 9 --- [ocp-async-1,82cf8931a9fde784,df42443ffd0bed30] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:19.462 INFO 9 --- [ocp-schedules-4,ca70329abc3ede4e,30e86e92e4c83294] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:04:19.463 INFO 9 --- [ocp-schedules-4,ca70329abc3ede4e,30e86e92e4c83294] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:04:19.636 INFO 9 --- [prometheus-minute-schedule-1,54799ff6b39cfa49,48df0d078afa1279] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:19.639 INFO 9 --- [prometheus-minute-schedule-1,54799ff6b39cfa49,48df0d078afa1279] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:20.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:04:20.003507+08:00, lastProcessTime=2025-09-16T14:04:10.004906+08:00 2025-09-16 14:04:20.117 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:04:20.003507+08:00 2025-09-16 14:04:20.191 INFO 9 --- [ocp-async-10,9e620c22b8d06a7f,ad230f976bacf336] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:04:20.636 INFO 9 --- [prometheus-cache-monitor1,605b045dc695942c,4feedf47ee56c5c5] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15416,"minuteWriteQueue":0,"minuteReadCacheSize":7203,"secondWriteCacheSize":3811,"seriesIdKeySize":16772,"secondWriteQueue":0,"minuteWriteCacheSize":7198} 2025-09-16 14:04:20.636 INFO 9 --- [prometheus-cache-monitor1,605b045dc695942c,4feedf47ee56c5c5] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:04:20.827 INFO 9 --- [ocp-async-5,dcf522f616af7455,6e9b283a6fb0fc28] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:20.827 WARN 9 --- [ocp-async-2,2aad6c8496df5f19,7114d274950b1494] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:21.659 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:21.660 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:22.636 INFO 9 --- [prometheus-minute-schedule-1,02a923d04862f87a,840d37f7712c2146] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:22.639 INFO 9 --- [prometheus-minute-schedule-1,02a923d04862f87a,840d37f7712c2146] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:22.827 INFO 9 --- [ocp-async-3,2f6b554513aaa45f,a07af6155ed3e38e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:22.827 WARN 9 --- [ocp-async-4,c874818fd1d651d5,d4dab07c60e733ba] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:22.976 INFO 9 --- [ocp-schedules-23,ca1d6f11fad40227,178e48f7600933ef] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:04:22.981 WARN 9 --- [scanner-1393949-1,ca1d6f11fad40227,dd692cec81a56259] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:04:22.991 INFO 9 --- [alarm-detect-20,ca1d6f11fad40227,91aafc32e2dabfa9] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:04:22.992 INFO 9 --- [alarm-detect-14,ca1d6f11fad40227,058331f767ee3542] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:04:22.993 INFO 9 --- [alarm-detect-12,ca1d6f11fad40227,3997977c022b9a70] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:04:22.996 WARN 9 --- [alarm-detect-16,ca1d6f11fad40227,930cb108b90be96a] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:04:22.996 WARN 9 --- [alarm-detect-16,ca1d6f11fad40227,930cb108b90be96a] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:04:23.005 INFO 9 --- [alarm-detect-11,ca1d6f11fad40227,bf39a76cd427ea31] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:04:24.202 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.205 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitr 2025-09-16 14:04:24.217 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.228 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.239 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.250 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.253 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.256 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.259 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.262 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.265 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : INEFFECTIVE_HINT found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.268 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.271 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : TABLE_SCAN_INDEX_NOT_EXISTS found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.274 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.SqlIndexDiagnoseService : AWFUL_PERFORMANCE_INDEX_USED found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:24.115, end=2025-09-16T14:03:24.199} 2025-09-16 14:04:24.274 INFO 9 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2025-09-16 14:04:24.660 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:24.661 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:24.827 INFO 9 --- [ocp-async-7,d86636e74b29a1fc,51d96993c1b1d36d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:24.827 WARN 9 --- [ocp-async-6,641a07503494171f,3d80c14d96e59ed4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:24.969 INFO 9 --- [ocp-schedules-2,559a19fff12d9c93,278c2ec9dbb236ea] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:04:25.636 INFO 9 --- [prometheus-minute-schedule-1,8e073b923746f37e,9ab4b8683a04ff7c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:25.639 INFO 9 --- [prometheus-minute-schedule-1,8e073b923746f37e,9ab4b8683a04ff7c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:26.514 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,8b3cfc3769c8a119,f1dfd70b60d05212] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=8b3cfc3769c8a119, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:04:26.514 INFO 9 --- [http-nio-0.0.0.0-8080-exec-4,8b3cfc3769c8a119,f1dfd70b60d05212] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=8b3cfc3769c8a119, duration=1 ms] 2025-09-16 14:04:26.515 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,9d77215d450ced8b,eb546e686a99f521] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=9d77215d450ced8b, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:04:26.516 INFO 9 --- [http-nio-0.0.0.0-8080-exec-10,9d77215d450ced8b,eb546e686a99f521] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=9d77215d450ced8b, duration=1 ms] 2025-09-16 14:04:26.827 INFO 9 --- [ocp-async-8,a1ff2d52d3dca008,7fe217da9abed24e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:26.827 WARN 9 --- [ocp-async-9,535c7e1c6abfd1ca,5180c6936adcd3b5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:27.661 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:27.661 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:28.407 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.410 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitra 2025-09-16 14:04:28.424 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.424 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION is disabled or lacking of config 2025-09-16 14:04:28.437 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.449 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 15 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.518 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=1, name=sys, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-15T18:17:28+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3;zone4;zone5, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=null, obTenantId=1, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=null, logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=null), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.522 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.525 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 1 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.533 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.536 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 1 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.542 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=3, name=vas_ucs, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:42:01+08:00, primaryZone=RANDOM, zoneList=zone1;zone2;zone3, locality=FULL{1}@zone1, FULL{1}@zone2, FULL{1}@zone3, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=vas和ucs使用, obTenantId=1004, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_vas, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.546 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : ROW_LOCK_CONTENTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.549 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : PERFORMANCE_DEGRADATION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.552 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : EXECUTION_SPIKE found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.556 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : CPU_TIME_PROPORTION_HIGH found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.559 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.SqlPerfDiagnoseService : DML_WITH_UNNECESSARY_PARTITION found out 0 diagnose targets Pair(left=Tenant(id=2, name=cos, clusterName=zhengqi, obClusterId=1, clusterId=1, arbitrationServiceId=null, clusterType=PRIMARY, clusterStatus=RUNNING, syncStatus=VALID, mode=MYSQL, createTime=2025-09-16T10:24:14+08:00, primaryZone=RANDOM, zoneList=zone4;zone5, locality=FULL{1}@zone4, FULL{1}@zone5, status=NORMAL, operatingTaskInstanceId=null, statusAnalysis=null, locked=false, readonly=false, obVersion=4.3.5.3, description=用于cos系统, obTenantId=1002, sqlAuditEnabled=null, arbitrationStatus=DISABLED, role=PRIMARY, serviceNameInfo=TenantServiceNameInfo(serviceName=service_zhengqi_cos, serviceNameStatus=VALID, conflictTenant=null), logTransportMode=null, ocpClusterView=null, basicPrimaryTenant=null, basicStandbyTenantList=null, tags=null, loadType=HTAP), right=null), Interval{start=2025-09-16T13:58:28.228, end=2025-09-16T14:03:28.406} 2025-09-16 14:04:28.559 INFO 9 --- [pool-18-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 4 dubious sqls 2025-09-16 14:04:28.636 INFO 9 --- [prometheus-minute-schedule-1,7da10b8ad0edb861,78e1b6e87e5f778f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:28.639 INFO 9 --- [prometheus-minute-schedule-1,7da10b8ad0edb861,78e1b6e87e5f778f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:28.828 INFO 9 --- [ocp-async-5,c48cee6b86d12337,9b9d8297e9fbc68e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:28.828 WARN 9 --- [ocp-async-10,3f9f9923dbdd604b,d8a51c488c38c2e0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:29.468 INFO 9 --- [ocp-schedules-20,c7d8a4ea369766fd,1d44e79557589915] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:04:29.470 INFO 9 --- [ocp-schedules-20,c7d8a4ea369766fd,1d44e79557589915] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:04:29.938 INFO 9 --- [ocp-schedules-15,ad6e4ed22167f065,ad90b6d5e7a26478] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:04:29.941 INFO 9 --- [ocp-schedules-10,fb85eeca6b511481,ed2ea03adb698397] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:04:29.941 INFO 9 --- [ocp-schedules-9,0b2f6fde71ed96ef,2f236e32e8c9ab26] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:04:29.942 INFO 9 --- [ocp-schedules-26,cab9ab1e73ef1a96,be6e6d6038af44fc] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:04:29.942 INFO 9 --- [ocp-schedules-10,fb85eeca6b511481,ed2ea03adb698397] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:29.943 INFO 9 --- [ocp-schedules-9,0b2f6fde71ed96ef,2f236e32e8c9ab26] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:29.944 INFO 9 --- [ocp-schedules-26,cab9ab1e73ef1a96,be6e6d6038af44fc] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:29.944 INFO 9 --- [ocp-schedules-26,cab9ab1e73ef1a96,be6e6d6038af44fc] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:04:29.944 INFO 9 --- [ocp-schedules-25,d2f0558a101176c1,0381c6f7e39dd9b3] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:29.944 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:04:29.944 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:04:29.944 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:04:29.944 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:04:29.945 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:04:29.945 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:04:29.945 INFO 9 --- [ocp-schedules-15,812518ac1f2a67bb,e8c063eb9693b608] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:29.945 INFO 9 --- [host-check-clockdiff1,812518ac1f2a67bb,53d98e975ce621a1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:04:29.945 INFO 9 --- [host-check-clockdiff2,812518ac1f2a67bb,37e92751355feed5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:04:29.945 INFO 9 --- [host-check-clockdiff3,812518ac1f2a67bb,2b4bb14f35bad095] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:04:29.945 INFO 9 --- [ocp-schedules-1,28f4d771f9939428,86f63bbfa82102f3] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:29.945 INFO 9 --- [host-check-clockdiff4,812518ac1f2a67bb,23bd2001373fbb3f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:04:29.945 INFO 9 --- [host-check-clockdiff5,812518ac1f2a67bb,cd133e71d6c38311] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:04:29.945 INFO 9 --- [host-check-clockdiff6,812518ac1f2a67bb,dea31deb200963fb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:04:29.946 INFO 9 --- [host-check-agent-status1,28f4d771f9939428,386c2925ced1832e] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:04:29.946 INFO 9 --- [host-check-agent-status3,28f4d771f9939428,5169e83f9afed33b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:04:29.946 INFO 9 --- [host-check-agent-status4,28f4d771f9939428,9b2eebb375c31f7a] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:04:29.946 INFO 9 --- [host-check-agent-status5,28f4d771f9939428,748b62c3e33e5011] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:04:29.946 INFO 9 --- [host-check-agent-status2,28f4d771f9939428,5bb8fe1b3559bcb5] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:04:29.946 INFO 9 --- [host-check-agent-status6,28f4d771f9939428,5ed69acdf4b8c79c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:04:29.947 INFO 9 --- [ocp-schedules-24,e83c7a387f03407f,b27258864f8d571e] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:04:29.950 INFO 9 --- [host-check-clockdiff1,812518ac1f2a67bb,53d98e975ce621a1] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002669 -1 -1 , error= 2025-09-16 14:04:29.950 INFO 9 --- [host-check-clockdiff2,812518ac1f2a67bb,37e92751355feed5] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002669 -2 -2 , error= 2025-09-16 14:04:29.954 INFO 9 --- [host-check-clockdiff3,812518ac1f2a67bb,2b4bb14f35bad095] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002669 -2 -2 , error= 2025-09-16 14:04:29.954 INFO 9 --- [host-check-clockdiff6,812518ac1f2a67bb,dea31deb200963fb] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002669 -1 -1 , error= 2025-09-16 14:04:29.954 INFO 9 --- [host-check-clockdiff5,812518ac1f2a67bb,cd133e71d6c38311] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002669 -1 -1 , error= 2025-09-16 14:04:29.955 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:04:29.955 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:04:29.955 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:04:29.956 INFO 9 --- [host-check-agent-status1,28f4d771f9939428,386c2925ced1832e] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:04:29.956 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:04:29.956 INFO 9 --- [host-check-agent-status5,28f4d771f9939428,748b62c3e33e5011] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:04:29.956 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:29.956 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:04:29.956 INFO 9 --- [host-check-agent-status6,28f4d771f9939428,5ed69acdf4b8c79c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:29.957 INFO 9 --- [host-check-agent-status3,28f4d771f9939428,5169e83f9afed33b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:04:29.957 INFO 9 --- [host-check-agent-status4,28f4d771f9939428,9b2eebb375c31f7a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:04:29.957 INFO 9 --- [host-check-clockdiff4,812518ac1f2a67bb,23bd2001373fbb3f] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002669 -1 -1 , error= 2025-09-16 14:04:29.957 INFO 9 --- [host-check-agent-status1,28f4d771f9939428,386c2925ced1832e] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:04:29.957 INFO 9 --- [host-check-agent-status5,28f4d771f9939428,748b62c3e33e5011] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:04:29.958 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:04:29.958 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:04:29.958 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:04:29.958 INFO 9 --- [host-check-agent-status6,28f4d771f9939428,5ed69acdf4b8c79c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:29.958 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:04:29.958 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:29.958 INFO 9 --- [host-check-agent-status3,28f4d771f9939428,5169e83f9afed33b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:04:29.958 INFO 9 --- [host-check-agent-status4,28f4d771f9939428,9b2eebb375c31f7a] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:04:29.958 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:04:29.959 INFO 9 --- [host-check-agent-status2,28f4d771f9939428,5bb8fe1b3559bcb5] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:04:29.959 INFO 9 --- [host-check-agent-status2,28f4d771f9939428,5bb8fe1b3559bcb5] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:04:29.962 INFO 9 --- [ocp-schedules-23,a25ae9872cf78f8f,183d3f6498612aba] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2025-09-16 14:04:29.963 INFO 9 --- [ocp-schedules-8,7d53859747c7b283,cc0d87fd5df3387b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2025-09-16 14:04:29.967 INFO 9 --- [ocp-schedules-23,a25ae9872cf78f8f,183d3f6498612aba] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2025-09-16 14:04:29.969 INFO 9 --- [ocp-schedules-8,7d53859747c7b283,cc0d87fd5df3387b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2025-09-16 14:04:29.972 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:04:29.972 INFO 9 --- [host-check-agent-status4,28f4d771f9939428,9b2eebb375c31f7a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:04:29.972 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:04:29.973 INFO 9 --- [host-check-agent-status1,28f4d771f9939428,386c2925ced1832e] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:04:29.973 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:04:29.973 INFO 9 --- [host-check-agent-status3,28f4d771f9939428,5169e83f9afed33b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:04:29.973 INFO 9 --- [host-check-agent-status5,28f4d771f9939428,748b62c3e33e5011] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:04:29.973 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:29.973 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:04:29.973 INFO 9 --- [host-check-agent-status6,28f4d771f9939428,5ed69acdf4b8c79c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:04:29.974 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:29.974 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:04:29.974 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:04:29.974 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:04:29.972985760+08:00 2025-09-16 14:04:29.974 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:04:29.974+08:00 2025-09-16 14:04:29.974 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:04:29.973195446+08:00 2025-09-16 14:04:29.974 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:04:29.973160799+08:00 2025-09-16 14:04:29.975 INFO 9 --- [host-check-agent-status2,28f4d771f9939428,5bb8fe1b3559bcb5] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:04:29.975 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:04:29.974+08:00 2025-09-16 14:04:29.975 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:04:29.974+08:00 2025-09-16 14:04:29.975 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:04:29.973992367+08:00 2025-09-16 14:04:29.975 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:04:29.973763596+08:00 2025-09-16 14:04:29.975 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:04:29.975+08:00 2025-09-16 14:04:29.975 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:04:29.975+08:00 2025-09-16 14:04:29.975 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:04:29.974727910+08:00 2025-09-16 14:04:29.976 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:04:29.975+08:00 2025-09-16 14:04:29.976 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:04:29.974+08:00 and status AVAILABLE 2025-09-16 14:04:29.976 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:04:29.974+08:00 and status AVAILABLE 2025-09-16 14:04:29.977 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:04:29.974+08:00 and status AVAILABLE 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status1,28f4d771f9939428,386c2925ced1832e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status1,28f4d771f9939428,386c2925ced1832e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status1,28f4d771f9939428,386c2925ced1832e] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status4,28f4d771f9939428,9b2eebb375c31f7a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status4,28f4d771f9939428,9b2eebb375c31f7a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status4,28f4d771f9939428,9b2eebb375c31f7a] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:04:29.977 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:04:29.975+08:00 and status AVAILABLE 2025-09-16 14:04:29.977 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:04:29.975+08:00 and status AVAILABLE 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status3,28f4d771f9939428,5169e83f9afed33b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status3,28f4d771f9939428,5169e83f9afed33b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status3,28f4d771f9939428,5169e83f9afed33b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status5,28f4d771f9939428,748b62c3e33e5011] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status5,28f4d771f9939428,748b62c3e33e5011] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:04:29.977 INFO 9 --- [host-check-agent-status5,28f4d771f9939428,748b62c3e33e5011] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:04:29.977 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:04:29.975+08:00 and status AVAILABLE 2025-09-16 14:04:29.978 INFO 9 --- [host-check-agent-status6,28f4d771f9939428,5ed69acdf4b8c79c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:04:29.978 INFO 9 --- [host-check-agent-status6,28f4d771f9939428,5ed69acdf4b8c79c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:04:29.978 INFO 9 --- [host-check-agent-status6,28f4d771f9939428,5ed69acdf4b8c79c] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:04:29.978 INFO 9 --- [host-check-agent-status2,28f4d771f9939428,5bb8fe1b3559bcb5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:04:29.978 INFO 9 --- [host-check-agent-status2,28f4d771f9939428,5bb8fe1b3559bcb5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:04:29.978 INFO 9 --- [host-check-agent-status2,28f4d771f9939428,5bb8fe1b3559bcb5] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:04:29.979 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:04:29.979 INFO 9 --- [ocp-schedules-9,0b2f6fde71ed96ef,2f236e32e8c9ab26] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:04:29.979 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:04:29.981 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:04:29.981 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:04:29.981 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:04:29.981 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:04:29.981 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:04:29.985 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:04:29.986 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:04:29.986 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:04:29.986 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:04:29.986 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:04:29.986 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:04:29.987 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:29.987 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:04:29.987 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:04:29.987 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:04:29.987 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:04:29.988 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:29.989 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:04:30.003 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:04:30.003 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:04:30.003 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:04:30.003 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:04:30.003 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:04:30.004 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:04:30.007 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:04:30.005932+08:00, lastProcessTime=2025-09-16T14:04:20.003507+08:00 2025-09-16 14:04:30.029 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:30.030 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:30.030 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:04:30.031 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:04:30.031 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:04:30.031 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:04:30.031 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:04:30.032 INFO 9 --- [ocp-schedules-27,db61d55f14a79b43,f69edeb5862fbbd5] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":15416,"minuteWriteQueue":0,"minuteReadCacheSize":7203,"secondWriteCacheSize":3811,"seriesIdKeySize":16772,"secondWriteQueue":0,"minuteWriteCacheSize":7198} 2025-09-16 14:04:30.032 INFO 9 --- [ocp-schedules-27,db61d55f14a79b43,f69edeb5862fbbd5] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sql_event_in_plsql_compilation=20, ob_query_rt_total_cumulative_count=33, ob_sysstat_40012=21, node_memory_sreclaimable_bytes=24, ob_sysstat_40011=21, ob_server_resource_memory_assigned_bytes=14, ob_sysstat_40010=21, tcp_retrans=25, ob_unit_num=14, ob_database_disk_required_size=19, go_memstats_mspan_sys_bytes=18, ob_sysstat_30213=21, go_memstats_stack_sys_bytes=18, ob_sysstat_30212=21, exporter_export_metrics_bytes_total=25, ob_sysstat_30217=21, node_filesystem_size_bytes=51, ob_sysstat_30216=21, http_server_requests_seconds_count=172, ob_tenant_request_queue_total_size=24, jvm_gc_memory_allocated_bytes_total=8, ob_sysstat_200013=21, ob_compaction_frozen_time=8, ob_system_event_total_waits=30, ob_sysstat_200010=21, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=20, ob_sysstat_40019=21, ob_sysstat_40018=21, processor_process_metrics_total=22, ob_plan_cache_hit_total=20, jvm_gc_max_data_size_bytes=8, ob_sysstat_40027=21, ob_sysstat_40026=21, node_filesystem_readonly=50, ob_sysstat_40025=21, go_memstats_frees_total=18, io_await=37, host_available=12, ob_sysstat_30220=21, ob_sysstat_30222=21, ob_sql_event_in_sequence_load=20, ob_sysstat_30221=21, go_memstats_mallocs_total=18, ob_unit_config_max_memory_bytes=26, ob_sysstat_200006=21, ob_database_disk_data_size=18, io_util=37, ob_sysstat_200005=21, ob_sysstat_200002=21, primary_leaders_cnt=9, ob_sysstat_200001=21, ob_tenant_memstore_freeze_cnt=10, ob_tenant_disk_v4_data_size=12, ob_query_rt_table_total_cumulative_count=33, ob_sysstat_40028=21, ob_tenant_unit_min_memory=31, ob_sysstat_60087=21, ob_memstore_total_bytes=24, jvm_threads_states_threads=14, process_resident_memory_bytes=18, ob_cache_size_bytes=35, ob_tenant_assigned_cpu_total=20, ob_tenant_unit_max_memory=31, input_collect_metrics_total=23, ob_sysstat_50039=21, ob_sysstat_60083=21, ob_sysstat_50038=21, node_boot_time_seconds=24, node_disk_io_time_weighted_seconds_total=30, node_disk_write_time_seconds_total=30, cpu_count=25, output_write_metrics_total=16, ob_cluster_sync 2025-09-16 14:04:30.032 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:04:30.036 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:04:30.037 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:04:30.037 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:04:30.038 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:04:30.038 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:04:30.039 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:04:30.042 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:04:30.049 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:30.050 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:30.050 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:30.051 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:30.052 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:30.053 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:04:30.066 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:30.067 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:30.068 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:04:30.071 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:30.073 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:04:30.075 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:30.078 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:04:30.079 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:04:30.079 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:04:30.080 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:04:30.080 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:04:30.083 INFO 9 --- [ocp-schedules-22,1bacb0c4b629c70e,2291539c16b6231a] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 14:04:30.084 INFO 9 --- [ocp-schedules-22,1bacb0c4b629c70e,2291539c16b6231a] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2025-09-16 14:04:30.086 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:04:30.086 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:04:30.086 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:04:30.086 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:04:30.086 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:04:30.087 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:04:30.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:30.094 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:04:30.098 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:30.100 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:30.100 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:30.100 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:30.100 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:30.101 INFO 9 --- [prometheus-second-schedule-1,673de86165e31886,82744fc155a3f668] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=16, collectTaskCount=16 2025-09-16 14:04:30.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.105 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:30.106 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:04:30.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.119 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:30.126 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:04:30.127 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:04:30.128 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:04:30.128 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:04:30.129 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:04:30.132 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:04:30.005932+08:00 2025-09-16 14:04:30.133 INFO 9 --- [host-check-host-status2,d2f0558a101176c1,aa68bd2452613a89] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:04:30.133 INFO 9 --- [host-check-host-status1,d2f0558a101176c1,17ce683f959f02dd] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:04:30.134 INFO 9 --- [host-check-host-status5,d2f0558a101176c1,df7b47cee5ff052b] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:04:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.135 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:30.135 INFO 9 --- [host-check-host-status4,d2f0558a101176c1,d16e7d1a687e76c6] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:04:30.135 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:04:30.135 INFO 9 --- [host-check-host-status3,d2f0558a101176c1,60b9621bc86a9a87] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:04:30.142 INFO 9 --- [host-check-host-status6,d2f0558a101176c1,da2c7bc2953f5ef1] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:04:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.149 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:30.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.165 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:30.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.179 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:30.191 INFO 9 --- [ocp-async-8,498c23b44d380931,ca21ab24fa791df5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:04:30.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.194 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:04:30.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.208 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:04:30.225 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:04:30.239 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:30.240 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:30.241 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:30.246 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:04:30.249 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:04:30.252 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:30.253 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:30.267 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:04:30.287 INFO 9 --- [ocp-schedules-19,9c8c01e0c144cd6a,10720d0630025d75] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2025-09-16 14:04:30.288 INFO 9 --- [ocp-schedules-19,9c8c01e0c144cd6a,10720d0630025d75] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:30.288 INFO 9 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2025-09-16 14:04:30.289 INFO 9 --- [ocp-schedules-19,9c8c01e0c144cd6a,10720d0630025d75] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:04:30.295 INFO 9 --- [ocp-schedules-17,c21300a39996b2e1,0442372dcf15f0d8] c.o.o.s.common.scheduled.HostSchedules : Check host version schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:30.295 INFO 9 --- [ocp-schedules-17,c21300a39996b2e1,0442372dcf15f0d8] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-version, skip execute 2025-09-16 14:04:30.327 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:04:30.341 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:30.343 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:30.344 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:04:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:04:30.358 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:04:30.358 INFO 9 --- [ocp-schedules-10,fb85eeca6b511481,ed2ea03adb698397] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:04:30.421 INFO 9 --- [ocp-schedules-26,28ea6471782ab44c,16a90332e419be34] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2025-09-16 14:04:30.611 INFO 9 --- [ocp-schedules-6,bd7a170528e28f68,b16ee0f9d0e872c6] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2025-09-16 14:04:30.613 INFO 9 --- [ocp-schedules-6,bd7a170528e28f68,b16ee0f9d0e872c6] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2025-09-16 14:04:30.613 INFO 9 --- [ocp-schedules-6,bd7a170528e28f68,b16ee0f9d0e872c6] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2025-09-16 14:04:30.661 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:30.662 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:30.828 INFO 9 --- [ocp-async-6,06e5a42928d04f83,534afd65f7be7cd7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:30.828 WARN 9 --- [ocp-async-2,7f6fbb930c372277,d45a5afd8a3fd987] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:30.887 INFO 9 --- [ocp-schedules-22,e3d367ddb1aa7084,8023d7a93e70f462] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:04:31.011 INFO 9 --- [ocp-schedules-30,266a7f1a7fe8bef7,4a34c4fe13cf01ad] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2025-09-16 14:04:31.011 INFO 9 --- [ocp-schedules-30,266a7f1a7fe8bef7,4a34c4fe13cf01ad] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2025-09-16 14:04:31.527 INFO 9 --- [ocp-schedules-5,60bd7dc23b88d831,3ab334ebdfa4f6d4] c.o.o.s.common.scheduled.OcpSchedules : Collect odp client metrics. 2025-09-16 14:04:31.527 INFO 9 --- [ocp-schedules-5,60bd7dc23b88d831,3ab334ebdfa4f6d4] c.o.o.s.o.OdpClientMetricCollectService : Begin to collect odp client memory, timestamp = 1758002671 2025-09-16 14:04:31.528 INFO 9 --- [ocp-schedules-5,60bd7dc23b88d831,3ab334ebdfa4f6d4] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxymemory, args: [] 2025-09-16 14:04:31.636 INFO 9 --- [prometheus-minute-schedule-1,ad2a913acc04c714,cf26b2139671367d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:31.639 INFO 9 --- [prometheus-minute-schedule-1,ad2a913acc04c714,cf26b2139671367d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:31.708 INFO 9 --- [ocp-schedules-19,1a820658db8e1c6a,60a5b88c9b3aff40] c.o.o.s.c.scheduled.ClusterSchedules : Check certificate expired. 2025-09-16 14:04:31.734 INFO 9 --- [ocp-schedules-2,e64bbec5d964aadf,d60c8db0e76419ec] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2025-09-16 14:04:31.734 INFO 9 --- [ocp-schedules-2,e64bbec5d964aadf,d60c8db0e76419ec] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824445193931898880 2025-09-16 14:04:31.735 INFO 9 --- [ocp-schedules-2,e64bbec5d964aadf,d60c8db0e76419ec] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2025-09-16 14:04:31.735 INFO 9 --- [ocp-schedules-2,e64bbec5d964aadf,d60c8db0e76419ec] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824445282763063296 2025-09-16 14:04:31.735 INFO 9 --- [ocp-schedules-2,e64bbec5d964aadf,d60c8db0e76419ec] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2025-09-16 14:04:31.735 INFO 9 --- [ocp-schedules-2,e64bbec5d964aadf,d60c8db0e76419ec] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=824395454075027456 2025-09-16 14:04:31.770 INFO 9 --- [ocp-schedules-10,e5c7592e91919866,362e6bb49f2b5469] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration auto replace status 2025-09-16 14:04:31.847 INFO 9 --- [ocp-schedules-26,8508cf7e7da8cc56,40f0b7d35d324fd3] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2025-09-16 14:04:31.848 INFO 9 --- [ocp-schedules-26,8508cf7e7da8cc56,40f0b7d35d324fd3] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:31.862 INFO 9 --- [ocp-schedules-26,8508cf7e7da8cc56,40f0b7d35d324fd3] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=1 2025-09-16 14:04:32.433 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,6ddd8751967dc7d9,3ab36dfeb0858a8c] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=6ddd8751967dc7d9, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:04:32.434 INFO 9 --- [http-nio-0.0.0.0-8080-exec-5,6ddd8751967dc7d9,3ab36dfeb0858a8c] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=6ddd8751967dc7d9, duration=0 ms] 2025-09-16 14:04:32.435 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,c86b0b6491fd1769,69e711a974597600] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=c86b0b6491fd1769, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:04:32.435 INFO 9 --- [http-nio-0.0.0.0-8080-exec-1,c86b0b6491fd1769,69e711a974597600] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=c86b0b6491fd1769, duration=0 ms] 2025-09-16 14:04:32.828 INFO 9 --- [ocp-async-8,ce6f20eb0837b394,b5826c5237984871] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:32.828 WARN 9 --- [ocp-async-4,120ee7d9e4f95a8e,c08b4e1f3956ff4d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:33.007 INFO 9 --- [ocp-schedules-21,ee3c7cf95a59a76a,57ad01bfeb7901e8] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:04:33.012 WARN 9 --- [scanner-1394118-1,ee3c7cf95a59a76a,af1c3803084f400c] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:04:33.025 WARN 9 --- [alarm-detect-15,ee3c7cf95a59a76a,05e4efdcb64e1689] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:04:33.025 WARN 9 --- [alarm-detect-15,ee3c7cf95a59a76a,05e4efdcb64e1689] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:04:33.572 INFO 9 --- [ocp-schedules-17,4852726695085754,aa9905d1f088f65c] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2025-09-16 14:04:33.662 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:33.662 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:33.712 INFO 9 --- [ocp-schedules-23,2a50f6d9cb5a9c33,dd426d1ea1ab5a8c] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2025-09-16T14:04:33.712+08:00, clusters=[1] 2025-09-16 14:04:33.713 INFO 9 --- [ocp-schedules-23,2a50f6d9cb5a9c33,dd426d1ea1ab5a8c] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster zhengqi, trans stat result is empty. 2025-09-16 14:04:34.285 INFO 9 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2025-09-16 14:04:34.288 INFO 9 --- [ocp-schedules-24,7bfca4fc78a44a1f,a5ea420a0fbc9756] c.o.o.s.common.scheduled.OcpSchedules : Check local odp client connectable 2025-09-16 14:04:34.288 INFO 9 --- [ocp-schedules-24,7bfca4fc78a44a1f,a5ea420a0fbc9756] c.o.o.s.odpclient.OdpClientChecker : Begin to check local odp client connectable. 2025-09-16 14:04:34.288 INFO 9 --- [ocp-schedules-24,7bfca4fc78a44a1f,a5ea420a0fbc9756] c.o.o.s.obproxy.JdbcOdpPasswordOperator : [odpsdk] sql: show proxyconfig, args: [] 2025-09-16 14:04:34.304 INFO 9 --- [ocp-schedules-24,7bfca4fc78a44a1f,a5ea420a0fbc9756] c.o.o.s.odpclient.OdpClientChecker : Success to check local odp client connectable, connect success! 2025-09-16 14:04:34.636 INFO 9 --- [prometheus-minute-schedule-1,f45eb9549311875b,e674fe7ab9d99a95] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:34.639 INFO 9 --- [prometheus-minute-schedule-1,f45eb9549311875b,e674fe7ab9d99a95] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:34.828 WARN 9 --- [ocp-async-1,4584ecbb1592c11d,bc8825e2754e80e5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:34.828 INFO 9 --- [ocp-async-3,015a534ba7af8652,3fdf46ea2491c4cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:34.849 INFO 9 --- [ocp-schedules-4,938cc7fda39dcb4c,c5756576f98d8866] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:04:34.854 INFO 9 --- [ocp-schedules-4,938cc7fda39dcb4c,c5756576f98d8866] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:04:34.854 INFO 9 --- [ocp-schedules-4,938cc7fda39dcb4c,c5756576f98d8866] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:04:34.974 INFO 9 --- [ocp-schedules-17,a7be51beb6302210,754fb770dad99d3b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:04:35.910 INFO 9 --- [ocp-schedules-30,4b1522857f741756,7e98ba7ac80eea09] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2025-09-16T14:04:35.910+08:00, clusters=[1] 2025-09-16 14:04:35.913 INFO 9 --- [ocp-schedules-30,4b1522857f741756,7e98ba7ac80eea09] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster zhengqi for slowSqlStat, sql count is 0. 2025-09-16 14:04:36.663 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:36.663 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:36.828 INFO 9 --- [ocp-async-2,79e7460af95637ef,0c18c129072ce9c9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:36.828 WARN 9 --- [ocp-async-9,01d9a644770ba69c,72851034aba792e9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:37.636 INFO 9 --- [prometheus-minute-schedule-1,759f5ef0996588a6,5c6024632a63a7f7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:37.639 INFO 9 --- [prometheus-minute-schedule-1,759f5ef0996588a6,5c6024632a63a7f7] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:38.159 INFO 9 --- [ocp-schedules-11,d0488de9e734735c,a9da63ec0d9e270e] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster zone cgroup value. 2025-09-16 14:04:38.160 INFO 9 --- [ocp-schedules-11,d0488de9e734735c,a9da63ec0d9e270e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:38.181 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:38.182 INFO 9 --- [Check cluster cgroup value.1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [enable_cgroup] 2025-09-16 14:04:38.194 INFO 9 --- [ocp-schedules-11,d0488de9e734735c,a9da63ec0d9e270e] .o.o.s.t.b.c.AbstractShardingClusterTask : Check cluster cgroup value. executed completed, allCount=1, successCount=1 2025-09-16 14:04:38.828 WARN 9 --- [ocp-async-10,c0196f47379cd0b6,5ec610f58a23d172] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:38.828 INFO 9 --- [ocp-async-4,8681d7bf9714ae84,ec8e7880954b545d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:39.476 INFO 9 --- [ocp-schedules-24,4f1dd836d5af7ec5,fa37bbe6ff0b09d3] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:04:39.478 INFO 9 --- [ocp-schedules-24,4f1dd836d5af7ec5,fa37bbe6ff0b09d3] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:04:39.663 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:39.664 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:40.004 INFO 9 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=3 2025-09-16 14:04:40.005 INFO 9 --- [ocp-schedules-5,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=3 2025-09-16 14:04:40.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:04:40.003322+08:00, lastProcessTime=2025-09-16T14:04:30.005932+08:00 2025-09-16 14:04:40.122 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:04:40.003322+08:00 2025-09-16 14:04:40.191 INFO 9 --- [ocp-async-7,8266e09606fffd2d,0d9e79fb72307e69] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:04:40.313 INFO 9 --- [ocp-schedules-8,4203a3f5910a5205,e18eee8b273141c7] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2025-09-16 14:04:40.313 INFO 9 --- [ocp-schedules-8,4203a3f5910a5205,e18eee8b273141c7] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2025-09-16 14:04:40.316 INFO 9 --- [ocp-schedules-6,3426bac5cca03a5c,ea8dbbfcd46a6604] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:40.316 INFO 9 --- [ocp-schedules-6,3426bac5cca03a5c,ea8dbbfcd46a6604] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=10 2025-09-16 14:04:40.316 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=8 2025-09-16 14:04:40.316 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=7 2025-09-16 14:04:40.316 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=12 2025-09-16 14:04:40.316 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=9 2025-09-16 14:04:40.320 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:04:40.320 INFO 9 --- [ocp-schedules-6,3426bac5cca03a5c,ea8dbbfcd46a6604] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:04:40.320 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:04:40.320 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:40.320 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:04:40.321 INFO 9 --- [ocp-schedules-6,3426bac5cca03a5c,ea8dbbfcd46a6604] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:04:40.321 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:04:40.321 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:04:40.321 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:40.321 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:04:40.330 INFO 9 --- [Collect all tenants major compactions3,4203a3f5910a5205,11a2e097ececa550] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:cos 2025-09-16 14:04:40.330 INFO 9 --- [Collect all tenants major compactions2,4203a3f5910a5205,2ef690d87ed00dba] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:04:40.330 INFO 9 --- [Collect all tenants major compactions1,4203a3f5910a5205,87202eb63cff00a7] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:zhengqi, tenant:vas_ucs 2025-09-16 14:04:40.335 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62889/api/v1/log/alarms, params:null 2025-09-16 14:04:40.335 INFO 9 --- [ForkJoinPool.commonPool-worker-0,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62889/api/v1/log/alarms, params:null 2025-09-16 14:04:40.335 INFO 9 --- [ocp-schedules-6,3426bac5cca03a5c,ea8dbbfcd46a6604] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62889/api/v1/log/alarms, params:null 2025-09-16 14:04:40.336 INFO 9 --- [ForkJoinPool.commonPool-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62889/api/v1/log/alarms, params:null 2025-09-16 14:04:40.336 INFO 9 --- [ForkJoinPool.commonPool-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62889/api/v1/log/alarms, params:null 2025-09-16 14:04:40.337 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=11 2025-09-16 14:04:40.340 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:04:40.341 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:04:40.348 INFO 9 --- [Collect all tenants major compactions2,4203a3f5910a5205,2ef690d87ed00dba] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:40.348 INFO 9 --- [Collect all tenants major compactions1,4203a3f5910a5205,87202eb63cff00a7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:40.348 INFO 9 --- [Collect all tenants major compactions3,4203a3f5910a5205,11a2e097ececa550] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:40.349 INFO 9 --- [Collect all tenants major compactions1,4203a3f5910a5205,87202eb63cff00a7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2025-09-16 14:04:40.350 INFO 9 --- [Collect all tenants major compactions2,4203a3f5910a5205,2ef690d87ed00dba] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2025-09-16 14:04:40.350 INFO 9 --- [Collect all tenants major compactions3,4203a3f5910a5205,11a2e097ececa550] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2025-09-16 14:04:40.354 INFO 9 --- [Collect all tenants major compactions1,4203a3f5910a5205,87202eb63cff00a7] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:04:40.354 INFO 9 --- [ForkJoinPool.commonPool-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62889/api/v1/log/alarms, params:null 2025-09-16 14:04:40.354 INFO 9 --- [Collect all tenants major compactions3,4203a3f5910a5205,11a2e097ececa550] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2025-09-16 14:04:40.355 INFO 9 --- [Collect all tenants major compactions2,4203a3f5910a5205,2ef690d87ed00dba] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:zhengqi, tenant:sys 2025-09-16 14:04:40.355 INFO 9 --- [ocp-schedules-8,4203a3f5910a5205,e18eee8b273141c7] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2025-09-16 14:04:40.356 INFO 9 --- [ocp-schedules-6,3426bac5cca03a5c,ea8dbbfcd46a6604] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2025-09-16 14:04:40.636 INFO 9 --- [prometheus-minute-schedule-1,4f62448252affd90,cfde6db0c11f0fd4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:40.639 INFO 9 --- [prometheus-minute-schedule-1,4f62448252affd90,cfde6db0c11f0fd4] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:40.667 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,3ab737f983a61113,8f10c7bf1333224e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?Action=GetObProxyConfig&User_ID=admin&UID=alibaba&VersionOnly=true, client=10.232.140.0, traceId=3ab737f983a61113, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=admin,alibaba,,,true,] 2025-09-16 14:04:40.667 INFO 9 --- [http-nio-0.0.0.0-8080-exec-9,3ab737f983a61113,8f10c7bf1333224e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=3ab737f983a61113, duration=0 ms] 2025-09-16 14:04:40.828 INFO 9 --- [ocp-async-3,04f4588db772cf65,57afc5e98f29b531] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:40.828 WARN 9 --- [ocp-async-9,22203db65459ed3b,cbe29d5bcbb77d0a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:42.664 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:42.665 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:42.828 INFO 9 --- [ocp-async-2,46a9aa30f5ef4c9d,3ac9630bbf7f85d7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:42.828 WARN 9 --- [ocp-async-10,7e4123763c015c67,c6c6e93e73b525db] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:42.892 INFO 9 --- [ocp-schedules-27,351cfa2eea4a390b,48e4931d7cac3231] c.o.o.s.c.scheduled.TenantSchedules : Check suspend tenant compaction status 2025-09-16 14:04:42.892 INFO 9 --- [ocp-schedules-27,351cfa2eea4a390b,48e4931d7cac3231] s.t.b.t.CheckSuspendTenantCompactionTask : Check tenant compaction status. 2025-09-16 14:04:42.930 INFO 9 --- [ocp-schedules-27,351cfa2eea4a390b,48e4931d7cac3231] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:42.931 INFO 9 --- [ocp-schedules-27,351cfa2eea4a390b,48e4931d7cac3231] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION 2025-09-16 14:04:43.035 INFO 9 --- [ocp-schedules-7,b85965142f58d1f5,8c23e52e634eb836] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:04:43.041 WARN 9 --- [scanner-1394258-1,b85965142f58d1f5,b9b7f78bf284776f] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:04:43.051 INFO 9 --- [alarm-detect-10,b85965142f58d1f5,652f99faea8beae5] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_exists_expired_xa_trans,sql_alarm_type-trans_stat,trans_state-pending,trans_type-xa, startId: 38, data is empty. 2025-09-16 14:04:43.052 INFO 9 --- [alarm-detect-20,b85965142f58d1f5,82fa24bea0b7cf84] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_expired_trans_exist,is_xa_trans-0,sql_alarm_type-trans_stat,trans_state-pending, startId: 38, data is empty. 2025-09-16 14:04:43.053 INFO 9 --- [alarm-detect-7,b85965142f58d1f5,a964f3b0724ef73d] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_large_trans_exist,sql_alarm_type-trans_stat, startId: 38, data is empty. 2025-09-16 14:04:43.057 WARN 9 --- [alarm-detect-6,b85965142f58d1f5,54085f7809171e1c] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:04:43.057 WARN 9 --- [alarm-detect-6,b85965142f58d1f5,54085f7809171e1c] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:04:43.065 INFO 9 --- [alarm-detect-6,b85965142f58d1f5,e61e0b4159c3528e] c.o.o.a.c.d.metrics.SqlMetricsQuery : metric: ob_tenant_long_trans_exist,sql_alarm_type-trans_stat,trans_state-long, startId: 38, data is empty. 2025-09-16 14:04:43.636 INFO 9 --- [prometheus-minute-schedule-1,ef5bbd756588f303,64f1c3a21bbded3a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:43.639 INFO 9 --- [prometheus-minute-schedule-1,ef5bbd756588f303,64f1c3a21bbded3a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:44.829 INFO 9 --- [ocp-async-6,cd66823c69038d67,35b871a5d624c711] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:44.829 WARN 9 --- [ocp-async-8,035e0c8e2545aaef,3852ff4d8f97b9e4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:44.977 INFO 9 --- [ocp-schedules-5,3698dc7cbaf1f0c0,d1fb7c92fc6aca66] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:04:45.665 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:45.666 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:46.636 INFO 9 --- [prometheus-minute-schedule-1,3d90c46103926295,6e19ba5fea039c7e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:46.639 INFO 9 --- [prometheus-minute-schedule-1,3d90c46103926295,6e19ba5fea039c7e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:46.829 INFO 9 --- [ocp-async-1,e3a1f8615e3b4d1d,dec6f1569ce896d8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:46.829 WARN 9 --- [ocp-async-5,1acad25b7eab40c8,93bd1596e5570491] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:47.295 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,21de69e43a8796eb,04bbb0c3231c5c2d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq&VersionOnly=true, client=10.232.140.0, traceId=21de69e43a8796eb, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,true,] 2025-09-16 14:04:47.296 INFO 9 --- [http-nio-0.0.0.0-8080-exec-6,21de69e43a8796eb,04bbb0c3231c5c2d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=21de69e43a8796eb, duration=1 ms] 2025-09-16 14:04:47.297 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,6289f614e68a158a,670d658c2c0a9c7c] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=obproxy_zq, client=10.232.140.0, traceId=6289f614e68a158a, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,,obproxy_zq,false,] 2025-09-16 14:04:47.297 INFO 9 --- [http-nio-0.0.0.0-8080-exec-7,6289f614e68a158a,670d658c2c0a9c7c] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=10.232.140.0, traceId=6289f614e68a158a, duration=0 ms] 2025-09-16 14:04:48.226 INFO 9 --- [ocp-schedules-28,3729bca2c08b96cb,8d1373aaf96f38cd] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2025-09-16 14:04:48.227 INFO 9 --- [ocp-schedules-28,3729bca2c08b96cb,8d1373aaf96f38cd] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:48.276 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:04:48.276 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.279 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) ocp_query */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2025-09-16 14:04:48.302 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.303 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:04:48.326 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.327 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:04:48.349 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.350 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2025-09-16 14:04:48.352 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.353 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:04:48.376 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.377 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:04:48.400 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.400 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2025-09-16 14:04:48.405 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.405 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:04:48.428 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.429 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:04:48.453 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.454 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2025-09-16 14:04:48.471 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.472 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_TENANT_LOCALITY] 2025-09-16 14:04:48.473 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.474 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:04:48.475 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.476 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:04:48.476 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.477 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_TENANT_LOCALITY] 2025-09-16 14:04:48.478 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.478 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:04:48.479 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.480 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1002, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:04:48.497 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.498 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_TENANT_LOCALITY] 2025-09-16 14:04:48.499 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.500 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, SHRINK_RESOURCE_POOL_UNIT_NUM] 2025-09-16 14:04:48.500 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.501 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, JOB_ID, JOB_TYPE, JOB_STATUS, PROGRESS FROM oceanbase.DBA_OB_TENANT_JOBS WHERE TENANT_ID = ? AND JOB_TYPE = ? ORDER BY JOB_ID DESC LIMIT 1, args: [1004, ALTER_RESOURCE_TENANT_UNIT_NUM] 2025-09-16 14:04:48.518 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648001] sync all tenant whitelist start, clusterId=1 2025-09-16 14:04:48.519 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648111] default whitelist refreshed, defaultWhitelist=10.233.116.22 2025-09-16 14:04:48.546 INFO 9 --- [Sync all tenant information1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:04:48.548 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:48.548 INFO 9 --- [Sync all tenant information1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE name = ?, args: [ob_tcp_invited_nodes] 2025-09-16 14:04:48.575 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=2, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:04:48.575 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=2, userWhitelist=% 2025-09-16 14:04:48.575 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=1, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:04:48.575 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=1, userWhitelist=% 2025-09-16 14:04:48.575 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648201] user whitelist calculated, tenantId=3, realWhitelist=%, defaultWhitelist=127.0.0.1,10.233.116.22, userWhitelist=% 2025-09-16 14:04:48.575 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648202] user whitelist updated, tenantId=3, userWhitelist=% 2025-09-16 14:04:48.578 INFO 9 --- [Sync all tenant information1,,] c.o.o.o.i.t.TenantWhitelistServiceImpl : [OCP648002] sync all tenant whitelist done, clusterId=1 2025-09-16 14:04:48.578 INFO 9 --- [Sync all tenant information1,,] .o.s.t.b.t.SyncAllTenantInfoShardingTask : [OCP606] sync tenants success, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:04:48.578 INFO 9 --- [ocp-schedules-28,3729bca2c08b96cb,8d1373aaf96f38cd] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=1 2025-09-16 14:04:48.666 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:48.666 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:48.829 INFO 9 --- [ocp-async-3,a19aee16dfcba6d0,cc6b8034ded8e8e9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:48.829 WARN 9 --- [ocp-async-7,c9d520cbba16f8a1,3bfd5ec256c47b65] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 14:04:49,042 |-INFO in ReconfigureOnChangeTask(born:1758002509042) - Empty watch file list. Disabling 2025-09-16 14:04:49.223 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2025-09-16 14:04:49.238 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : got cluster:ObClusterEntity{id=1, name=zhengqi, obClusterId=1, status=RUNNING} 2025-09-16 14:04:49.252 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-3) 2025-09-16 14:04:49.252 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-4) 2025-09-16 14:04:49.252 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-1) 2025-09-16 14:04:49.252 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-2) 2025-09-16 14:04:49.252 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Submit concurrent group: (zhengqi:1-5) 2025-09-16 14:04:49.255 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.255 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.255 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.255 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.255 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.256 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:49.256 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:49.256 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:49.256 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:49.256 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:49.257 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.257 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.257 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.257 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.257 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:49.257 INFO 9 --- [sql-rollup-worker-3,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:04:49.258 INFO 9 --- [sql-rollup-worker-2,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:04:49.258 INFO 9 --- [sql-rollup-worker-4,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:04:49.258 INFO 9 --- [sql-rollup-worker-1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:04:49.258 INFO 9 --- [sql-rollup-worker-0,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ now() 2025-09-16 14:04:49.278 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=0->1, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T14:00:00, end=2025-09-16T14:02:30, updates=78, granule=120000ms, delay=150000ms 2025-09-16 14:04:49.278 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=0->1, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T14:00:00, end=2025-09-16T14:02:30, updates=71, granule=120000ms, delay=150000ms 2025-09-16 14:04:49.282 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=0->1, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T14:00:00, end=2025-09-16T14:02:30, updates=101, granule=120000ms, delay=150000ms 2025-09-16 14:04:49.282 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=0->1, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T14:00:00, end=2025-09-16T14:02:30, updates=131, granule=120000ms, delay=150000ms 2025-09-16 14:04:49.283 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T14:02:30, granule=120000ms, delay=0ms) 2025-09-16 14:04:49.283 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T14:02:30, granule=120000ms, delay=0ms) 2025-09-16 14:04:49.287 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T14:02:30, granule=120000ms, delay=0ms) 2025-09-16 14:04:49.287 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T14:02:30, granule=120000ms, delay=0ms) 2025-09-16 14:04:49.287 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=0->1, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T14:00:00, end=2025-09-16T14:02:30, updates=189, granule=120000ms, delay=150000ms 2025-09-16 14:04:49.292 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=0->1, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T14:02:30, granule=120000ms, delay=0ms) 2025-09-16 14:04:49.298 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=3, level=1->2, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T13:47:30, end=2025-09-16T13:57:30, updates=98, granule=600000ms, delay=900000ms 2025-09-16 14:04:49.299 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=2, level=1->2, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T13:47:30, end=2025-09-16T13:57:30, updates=90, granule=600000ms, delay=900000ms 2025-09-16 14:04:49.302 INFO 9 --- [sql-rollup-worker-0,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=3, level=1->2, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T13:57:30, granule=600000ms, delay=300000ms) 2025-09-16 14:04:49.302 INFO 9 --- [sql-rollup-worker-1,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=2, level=1->2, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T13:57:30, granule=600000ms, delay=300000ms) 2025-09-16 14:04:49.308 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=4, level=1->2, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T13:47:30, end=2025-09-16T13:57:30, updates=131, granule=600000ms, delay=900000ms 2025-09-16 14:04:49.310 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=1, level=1->2, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T13:47:30, end=2025-09-16T13:57:30, updates=180, granule=600000ms, delay=900000ms 2025-09-16 14:04:49.311 INFO 9 --- [sql-rollup-worker-4,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=4, level=1->2, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T13:57:30, granule=600000ms, delay=300000ms) 2025-09-16 14:04:49.315 INFO 9 --- [sql-rollup-worker-2,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=1, level=1->2, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T13:57:30, granule=600000ms, delay=300000ms) 2025-09-16 14:04:49.320 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Rollup server-side (cluster=zhengqi:1, server=5, level=1->2, c=0) - source=2025-09-16T14:02:30, start=2025-09-16T13:47:30, end=2025-09-16T13:57:30, updates=237, granule=600000ms, delay=900000ms 2025-09-16 14:04:49.323 INFO 9 --- [sql-rollup-worker-3,,] o.o.p.s.i.c.SqlAuditRawStatRollupService : Try rollup subsequent (cluster=zhengqi:1, server=5, level=1->2, c=1) - not enough cached interval (source=2025-09-16T14:02:30, target=2025-09-16T13:57:30, granule=600000ms, delay=300000ms) 2025-09-16 14:04:49.323 INFO 9 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=100ms, period=120000ms 2025-09-16 14:04:49.393 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2025-09-16 14:04:49.393 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.ocp.core.property.PropertyService : Refresh config properties 2025-09-16 14:04:49.396 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 14:04:49.396 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 14:04:49.396 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 14:04:49.396 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 14:04:49.399 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : new: [] 2025-09-16 14:04:49.399 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : init spring 2025-09-16 14:04:49.399 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2025-09-16 14:04:49.399 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : starting 2025-09-16 14:04:49.417 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 14:04:49.421 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 14:04:49.421 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 14:04:49.421 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 14:04:49.421 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 14:04:49.421 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 14:04:49.426 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 14:04:49.483 INFO 9 --- [ocp-schedules-7,2e4d134392e81990,ab0d9bdc23739c6e] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:04:49.485 INFO 9 --- [ocp-schedules-7,2e4d134392e81990,ab0d9bdc23739c6e] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:04:49.636 INFO 9 --- [prometheus-minute-schedule-1,7b01e108014c26a2,655dc78125acf690] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:49.639 INFO 9 --- [prometheus-minute-schedule-1,7b01e108014c26a2,655dc78125acf690] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:49.691 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2025-09-16 14:04:49.971 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.572785637S 2025-09-16 14:04:49.972 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2025-09-16 14:04:50.004 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:04:50.002425+08:00, lastProcessTime=2025-09-16T14:04:40.003322+08:00 2025-09-16 14:04:50.025 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2025-09-16 14:04:50.025 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2025-09-16 14:04:50.052 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 14:04:50,065 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 14:04:50,065 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 14:04:50,065 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Worker thread will flush remaining events before exiting. 14:04:50,065 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Queue flush finished successfully within timeout. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Worker thread will flush remaining events before exiting. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Queue flush finished successfully within timeout. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Worker thread will flush remaining events before exiting. 14:04:50,067 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Queue flush finished successfully within timeout. 14:04:50,068 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@5a2691b0 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] is not of type file 14:04:50,070 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/classes!/logback-spring.xml] 14:04:50,070 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 1 minutes 14:04:50,072 |-INFO in ch.qos.logback.core.joran.util.ConfigurationWatchListUtil@4b29f03e - Adding [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] to configuration watch list. 14:04:50,072 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@5a2691b0 - URL [jar:file:/home/admin/ocp-server/lib/ocp-server-ce-4.3.6-20250709105610.jar!/BOOT-INF/lib/spring-boot-2.7.18.jar!/org/springframework/boot/logging/logback/defaults.xml] is not of type file 14:04:50,073 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word clr with class [org.springframework.boot.logging.logback.ColorConverter] 14:04:50,073 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wex with class [org.springframework.boot.logging.logback.WhitespaceThrowableProxyConverter] 14:04:50,073 |-INFO in ch.qos.logback.core.joran.action.ConversionRuleAction - registering conversion word wEx with class [org.springframework.boot.logging.logback.ExtendedWhitespaceThrowableProxyConverter] 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.startup.DigesterFactory] to ERROR 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating ERROR level on Logger[org.apache.catalina.startup.DigesterFactory] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.catalina.util.LifecycleBase] to ERROR 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating ERROR level on Logger[org.apache.catalina.util.LifecycleBase] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.coyote.http11.Http11NioProtocol] to WARN 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating WARN level on Logger[org.apache.coyote.http11.Http11NioProtocol] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.sshd.common.util.SecurityUtils] to WARN 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating WARN level on Logger[org.apache.sshd.common.util.SecurityUtils] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.apache.tomcat.util.net.NioSelectorPool] to WARN 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating WARN level on Logger[org.apache.tomcat.util.net.NioSelectorPool] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.eclipse.jetty.util.component.AbstractLifeCycle] to ERROR 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating ERROR level on Logger[org.eclipse.jetty.util.component.AbstractLifeCycle] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.hibernate.validator.internal.util.Version] to WARN 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating WARN level on Logger[org.hibernate.validator.internal.util.Version] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework.boot.actuate.endpoint.jmx] to WARN 14:04:50,073 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating WARN level on Logger[org.springframework.boot.actuate.endpoint.jmx] onto the JUL framework 14:04:50,073 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 14:04:50,073 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [TASK_LOG_OUT] 14:04:50,074 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 14:04:50,074 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 14:04:50,074 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 14:04:50,074 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_STDOUT_APPENDER] 14:04:50,074 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] 14:04:50,074 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Attaching appender named [STDOUT] to AsyncAppender. 14:04:50,074 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_STDOUT_APPENDER] - Setting discardingThreshold to 0 14:04:50,074 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 14:04:50,074 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE_APPENDER] 14:04:50,074 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@423099557 - setting totalSizeCap to 10 GB 14:04:50,074 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@423099557 - Archive files will be limited to [100 MB] each. 14:04:50,074 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@423099557 - Will use gz compression 14:04:50,074 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@423099557 - Will use the pattern /home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i for the active file 14:04:50,074 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@77724522 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/ocp.log.%d{yyyy-MM-dd}.%i.gz'. 14:04:50,074 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@77724522 - Roll-over at midnight. 14:04:50,074 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@77724522 - Setting initial period to Tue Sep 16 14:04:50 CST 2025 14:04:50,074 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@423099557 - Cleaning on start up 14:04:50,074 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization 14:04:50,074 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start. 14:04:50,075 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - Active log file name: /home/admin/ocp-server/log/ocp.log 14:04:50,075 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE_APPENDER] - File property is set to [/home/admin/ocp-server/log/ocp.log] 14:04:50,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 14:04:50,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_FILE_APPENDER] 14:04:50,075 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] 14:04:50,075 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Attaching appender named [FILE_APPENDER] to AsyncAppender. 14:04:50,075 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_FILE_APPENDER] - Setting discardingThreshold to 0 14:04:50,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 14:04:50,075 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS_LOG_APPENDER] 14:04:50,075 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1361204948 - setting totalSizeCap to 10 GB 14:04:50,076 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1361204948 - Archive files will be limited to [100 MB] each. 14:04:50,076 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1361204948 - Will use gz compression 14:04:50,076 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1361204948 - Will use the pattern /home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i for the active file 14:04:50,076 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@77564a81 - The date pattern is 'yyyy-MM-dd' from file name pattern '/home/admin/ocp-server/log/access.log.%d{yyyy-MM-dd}.%i.gz'. 14:04:50,076 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@77564a81 - Roll-over at midnight. 14:04:50,076 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@77564a81 - Setting initial period to Tue Sep 16 14:04:47 CST 2025 14:04:50,076 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - Active log file name: /home/admin/ocp-server/log/access.log 14:04:50,076 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS_LOG_APPENDER] - File property is set to [/home/admin/ocp-server/log/access.log] 14:04:50,076 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender] 14:04:50,076 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ASYNC_ACCESS_LOG_APPENDER] 14:04:50,076 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS_LOG_APPENDER] to ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] 14:04:50,076 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Attaching appender named [ACCESS_LOG_APPENDER] to AsyncAppender. 14:04:50,076 |-INFO in ch.qos.logback.classic.AsyncAppender[ASYNC_ACCESS_LOG_APPENDER] - Setting discardingThreshold to 0 14:04:50,076 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [USER-ACCESS-LOG] to INFO 14:04:50,076 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating INFO level on Logger[USER-ACCESS-LOG] onto the JUL framework 14:04:50,076 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [USER-ACCESS-LOG] to false 14:04:50,076 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_ACCESS_LOG_APPENDER] to Logger[USER-ACCESS-LOG] 14:04:50,076 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO 14:04:50,076 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating INFO level on Logger[ROOT] onto the JUL framework 14:04:50,076 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [TASK_LOG_OUT] to Logger[ROOT] 14:04:50,076 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_STDOUT_APPENDER] to Logger[ROOT] 14:04:50,076 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ASYNC_FILE_APPENDER] to Logger[ROOT] 14:04:50,076 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration. 14:04:50,076 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@12684a1c - Registering current configuration as safe fallback point 14:04:50,078 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Removed 0 Bytes of files 14:04:50,080 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating INFO level on Logger[web] onto the JUL framework 14:04:50,080 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating INFO level on Logger[org.hibernate.SQL] onto the JUL framework 14:04:50,080 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@6204a560 - Propagating INFO level on Logger[com.oceanbase.ocp] onto the JUL framework 2025-09-16 14:04:50.081 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2025-09-16 14:04:50.082 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2025-09-16 14:04:50.082 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2025-09-16 14:04:50.082 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.6 2025-09-16 14:04:50.082 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.6 2025-09-16 14:04:50.082 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2025-09-16 14:04:50.088 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2025-09-16 14:04:50.127 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:04:50.002425+08:00 2025-09-16 14:04:50.180 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] o.s.boot.SpringApplication : Started application in 0.784 seconds (JVM running for 13665.225) 2025-09-16 14:04:50.180 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.784492207S 2025-09-16 14:04:50.191 INFO 9 --- [ocp-async-5,3749249f60f1dd3e,0808e83e36e2f769] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:04:50.453 INFO 9 --- [ocp-schedules-30,f2c245568caa9a88,06a81d6cbe402bfa] c.o.ocp.core.property.PropertyService : Refresh config properties done 2025-09-16 14:04:50.829 INFO 9 --- [ocp-async-4,c6f7f757d05ec45f,c71e244258656de4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:50.829 WARN 9 --- [ocp-async-6,0d4e60f2d928f8c2,e422362a67b3f440] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:51.666 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:51.667 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:52.636 INFO 9 --- [prometheus-minute-schedule-1,c43a2d48355498bd,6daaca5a1eb4d2b5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:52.639 INFO 9 --- [prometheus-minute-schedule-1,c43a2d48355498bd,6daaca5a1eb4d2b5] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:52.829 WARN 9 --- [ocp-async-1,a94f0b0422d4186d,ba7487b26e83cd0d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:52.829 INFO 9 --- [ocp-async-9,10391b8e1a7b21f9,d4e45dbdad419eb2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:53.069 INFO 9 --- [ocp-schedules-29,02d876cbd8ff58ed,6dc930687f607304] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2025-09-16 14:04:53.073 WARN 9 --- [scanner-1394434-1,02d876cbd8ff58ed,799117a797ecbcc6] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 34 2025-09-16 14:04:53.086 WARN 9 --- [alarm-detect-1,02d876cbd8ff58ed,19c4bca33c476ebe] c.o.o.m.calculate.OcpPrometheusAstNode : Scan metrics failed, message=java.lang.NullPointerException 2025-09-16 14:04:53.086 WARN 9 --- [alarm-detect-1,02d876cbd8ff58ed,19c4bca33c476ebe] c.o.o.m.query.OcpInnerQueryServiceImpl : Inner query metric failed. com.oceanbase.ocp.core.exception.OcpException: [OCP OcpException]: status=500 INTERNAL_SERVER_ERROR, errorCode=SCAN_DATA_ERROR, args=java.util.concurrent.ExecutionException: java.lang.NullPointerException at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.doGet(OcpPrometheusAstNode.java:268) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.afterPrepare(OcpPrometheusAstNode.java:238) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:146) at com.oceanbase.ocp.monitor.calculate.OcpPrometheusAstNode.eval(OcpPrometheusAstNode.java:140) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQuery(OcpInnerQueryServiceImpl.java:133) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.innerQueryMetrics(OcpInnerQueryServiceImpl.java:75) at com.oceanbase.ocp.monitor.query.OcpInnerQueryServiceImpl.batchQueryMetric(OcpInnerQueryServiceImpl.java:50) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.defaultBatchQueryMetrics(LocalMetricQueryService.java:251) at com.oceanbase.ocp.monitor.query.LocalMetricQueryService.batchQueryMetric(LocalMetricQueryService.java:215) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:167) at com.oceanbase.ocp.alarm.core.detect.metrics.AlarmMetricsQuery.snapshots(AlarmMetricsQuery.java:95) at com.oceanbase.ocp.alarm.core.detect.MetricsQuery.snapshots(MetricsQuery.java:84) at com.oceanbase.ocp.alarm.core.detect.MetricDetector.detectByMetrics(MetricDetector.java:121) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detectByMetrics(AlarmRuleDetector.java:240) at com.oceanbase.ocp.alarm.core.detect.AlarmRuleDetector.detect(AlarmRuleDetector.java:198) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$doCall$0(AlarmDetectMetricTask.java:81) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.doCall(AlarmDetectMetricTask.java:77) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:70) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:37) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2025-09-16 14:04:54.667 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:54.668 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:54.829 INFO 9 --- [ocp-async-7,6594bf6cc38d9583,a66c0f807c4ecfe2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:54.829 WARN 9 --- [ocp-async-3,ea90f13391131a84,2d581bbd08bad771] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:54.856 INFO 9 --- [ocp-schedules-22,23eb6b35ca6fdb2e,2052659204bd35b8] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2025-09-16 14:04:54.861 INFO 9 --- [ocp-schedules-22,23eb6b35ca6fdb2e,2052659204bd35b8] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:04:54.861 INFO 9 --- [ocp-schedules-22,23eb6b35ca6fdb2e,2052659204bd35b8] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[ce8fcf19-88c2-4f34-9c89-687109d41d86] 2025-09-16 14:04:54.981 INFO 9 --- [ocp-schedules-5,4dab1014e04b3475,48f1b8c2d0deb569] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2025-09-16 14:04:55.636 INFO 9 --- [prometheus-minute-schedule-1,ea075f43bbe83982,7857138fc8a4d524] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:55.639 INFO 9 --- [prometheus-minute-schedule-1,ea075f43bbe83982,7857138fc8a4d524] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:56.829 INFO 9 --- [ocp-async-2,fef250ef6556538d,eb239d2769406f65] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:56.829 WARN 9 --- [ocp-async-8,f995041c8139bfd8,1ccf6f46fe1a9ac1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:57.668 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:04:57.669 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:04:58.636 INFO 9 --- [prometheus-minute-schedule-1,53c7b93ef9ccf60a,08376281b8d19091] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002700, interval=60 2025-09-16 14:04:58.639 INFO 9 --- [prometheus-minute-schedule-1,53c7b93ef9ccf60a,08376281b8d19091] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:04:58.829 WARN 9 --- [ocp-async-5,4732091ee292d042,1886d241c562764d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:04:58.829 INFO 9 --- [ocp-async-1,138b99ff85b18316,00b3a19d0f6cceba] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:04:59.490 INFO 9 --- [ocp-schedules-15,81f7c6883feea1f1,16e5393ba6725044] c.o.o.s.c.scheduled.ClusterSchedules : Check arbitration service group 2025-09-16 14:04:59.492 INFO 9 --- [ocp-schedules-15,81f7c6883feea1f1,16e5393ba6725044] o.i.a.t.CheckArbitrationServiceGroupTask : No ob server lose connection with its arbitration 2025-09-16 14:04:59.938 INFO 9 --- [ocp-schedules-28,cd00fdf3ff0564f3,3a5af2a3a3881cf0] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2025-09-16 14:04:59.941 INFO 9 --- [ocp-schedules-28,b065d8fada4f6a60,bae091b0e845a51e] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2025-09-16 14:04:59.941 INFO 9 --- [ocp-schedules-29,19cc8c01c6b8ad17,5e6764544e7bf06b] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2025-09-16 14:04:59.942 INFO 9 --- [ocp-schedules-25,eae7620391bf1173,5631acedb48cee1a] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2025-09-16 14:04:59.943 INFO 9 --- [ocp-schedules-28,b065d8fada4f6a60,bae091b0e845a51e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:59.943 INFO 9 --- [ocp-schedules-29,19cc8c01c6b8ad17,5e6764544e7bf06b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:59.943 INFO 9 --- [ocp-schedules-25,eae7620391bf1173,5631acedb48cee1a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2025-09-16 14:04:59.944 INFO 9 --- [ocp-schedules-25,eae7620391bf1173,5631acedb48cee1a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2025-09-16 14:04:59.944 INFO 9 --- [ocp-schedules-22,cf9567d06c59a69e,7d824bdb2d46ff32] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:59.944 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:04:59.944 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:04:59.944 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:04:59.945 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:04:59.945 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:04:59.945 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:04:59.945 INFO 9 --- [ocp-schedules-20,d559268370f52426,38da362ba059410c] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:59.945 INFO 9 --- [ocp-schedules-6,640341a1ed8e6ce0,b88f03631348f06a] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[192.168.0.46, 192.168.0.54, 192.168.0.85, 192.168.0.104, 192.168.0.111, 192.168.0.159] 2025-09-16 14:04:59.945 INFO 9 --- [host-check-clockdiff1,d559268370f52426,e853fc5489181c50] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.46], timeoutMillis=20000 2025-09-16 14:04:59.945 INFO 9 --- [host-check-clockdiff2,d559268370f52426,14eb5f1fe0c3e1bc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.54], timeoutMillis=20000 2025-09-16 14:04:59.945 INFO 9 --- [host-check-clockdiff3,d559268370f52426,b9e0af01aa56e7b3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.85], timeoutMillis=20000 2025-09-16 14:04:59.945 INFO 9 --- [host-check-agent-status1,640341a1ed8e6ce0,2dc9e0421a519d5b] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=7, ip=192.168.0.46, originalStatus=AVAILABLE 2025-09-16 14:04:59.945 INFO 9 --- [host-check-clockdiff4,d559268370f52426,6eebd442784097cc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.104], timeoutMillis=20000 2025-09-16 14:04:59.946 INFO 9 --- [host-check-agent-status2,640341a1ed8e6ce0,4c6a55600dad0ca4] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=8, ip=192.168.0.54, originalStatus=ONLINE 2025-09-16 14:04:59.946 INFO 9 --- [host-check-clockdiff5,d559268370f52426,a51035a876b79153] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.111], timeoutMillis=20000 2025-09-16 14:04:59.946 INFO 9 --- [host-check-agent-status3,640341a1ed8e6ce0,d88f01edc6b4c1fc] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=9, ip=192.168.0.85, originalStatus=ONLINE 2025-09-16 14:04:59.946 INFO 9 --- [host-check-clockdiff6,d559268370f52426,4b06aa8af6e75f15] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[192.168.0.159], timeoutMillis=20000 2025-09-16 14:04:59.946 INFO 9 --- [host-check-agent-status4,640341a1ed8e6ce0,44f894447ee7aa13] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=10, ip=192.168.0.104, originalStatus=ONLINE 2025-09-16 14:04:59.946 INFO 9 --- [host-check-agent-status5,640341a1ed8e6ce0,bccf59dc681f4b1f] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=11, ip=192.168.0.111, originalStatus=ONLINE 2025-09-16 14:04:59.946 INFO 9 --- [host-check-agent-status6,640341a1ed8e6ce0,e3bd08856102840d] c.o.o.c.h.manager.HostCheckManagerImpl : Check host agent status, hostId=12, ip=192.168.0.159, originalStatus=ONLINE 2025-09-16 14:04:59.956 INFO 9 --- [ocp-schedules-13,a6b774c3305e5e93,794eb46532ccb3a4] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2025-09-16 14:04:59.957 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:04:59.957 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:04:59.957 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:04:59.957 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:04:59.958 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:59.958 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:04:59.958 INFO 9 --- [host-check-clockdiff2,d559268370f52426,14eb5f1fe0c3e1bc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002699 -1 -1 , error= 2025-09-16 14:04:59.958 INFO 9 --- [host-check-clockdiff3,d559268370f52426,b9e0af01aa56e7b3] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002699 -1 -1 , error= 2025-09-16 14:04:59.958 INFO 9 --- [host-check-clockdiff1,d559268370f52426,e853fc5489181c50] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002699 -1 -1 , error= 2025-09-16 14:04:59.958 INFO 9 --- [host-check-clockdiff4,d559268370f52426,6eebd442784097cc] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002699 -1 -1 , error= 2025-09-16 14:04:59.958 INFO 9 --- [host-check-clockdiff5,d559268370f52426,a51035a876b79153] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002699 -1 -1 , error= 2025-09-16 14:04:59.958 INFO 9 --- [host-check-clockdiff6,d559268370f52426,4b06aa8af6e75f15] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1758002699 -1 -1 , error= 2025-09-16 14:04:59.958 INFO 9 --- [host-check-agent-status1,640341a1ed8e6ce0,2dc9e0421a519d5b] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:04:59.959 INFO 9 --- [host-check-agent-status6,640341a1ed8e6ce0,e3bd08856102840d] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:59.959 INFO 9 --- [host-check-agent-status2,640341a1ed8e6ce0,4c6a55600dad0ca4] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:04:59.959 INFO 9 --- [host-check-agent-status3,640341a1ed8e6ce0,d88f01edc6b4c1fc] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:04:59.959 INFO 9 --- [host-check-agent-status4,640341a1ed8e6ce0,44f894447ee7aa13] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:04:59.959 INFO 9 --- [host-check-agent-status5,640341a1ed8e6ce0,bccf59dc681f4b1f] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:04:59.959 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:04:59.959 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:04:59.959 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:04:59.959 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:04:59.960 INFO 9 --- [host-check-agent-status2,640341a1ed8e6ce0,4c6a55600dad0ca4] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:04:59.960 INFO 9 --- [host-check-agent-status1,640341a1ed8e6ce0,2dc9e0421a519d5b] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:04:59.960 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:04:59.960 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:59.960 INFO 9 --- [host-check-agent-status6,640341a1ed8e6ce0,e3bd08856102840d] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:59.960 INFO 9 --- [host-check-agent-status4,640341a1ed8e6ce0,44f894447ee7aa13] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:04:59.960 INFO 9 --- [host-check-agent-status5,640341a1ed8e6ce0,bccf59dc681f4b1f] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:04:59.960 INFO 9 --- [host-check-agent-status3,640341a1ed8e6ce0,d88f01edc6b4c1fc] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:04:59.974 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/time, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/time, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-agent-status2,640341a1ed8e6ce0,4c6a55600dad0ca4] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.54:62888/api/v1/agent/status, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/time, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/time, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/time, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-agent-status5,640341a1ed8e6ce0,bccf59dc681f4b1f] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.111:62888/api/v1/agent/status, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-agent-status4,640341a1ed8e6ce0,44f894447ee7aa13] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.104:62888/api/v1/agent/status, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-agent-status1,640341a1ed8e6ce0,2dc9e0421a519d5b] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.46:62888/api/v1/agent/status, params:null 2025-09-16 14:04:59.974 INFO 9 --- [host-check-agent-status6,640341a1ed8e6ce0,e3bd08856102840d] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/agent/status, params:null 2025-09-16 14:04:59.975 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.159:62888/api/v1/time, params:null 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=8, ip=192.168.0.54, timestamp=2025-09-16T14:04:59.974388900+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=12, ip=192.168.0.159, timestamp=2025-09-16T14:04:59.974514941+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=11, ip=192.168.0.111, timestamp=2025-09-16T14:04:59.974931634+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=10, ip=192.168.0.104, timestamp=2025-09-16T14:04:59.974867480+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=9, ip=192.168.0.85, timestamp=2025-09-16T14:04:59.974548585+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.h.manager.HostCheckManagerImpl : Check host status result. id=7, ip=192.168.0.46, timestamp=2025-09-16T14:04:59.974870143+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=12, lastAvailableTime=2025-09-16T14:04:59.976+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=8, lastAvailableTime=2025-09-16T14:04:59.976+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=11, lastAvailableTime=2025-09-16T14:04:59.976+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=7, lastAvailableTime=2025-09-16T14:04:59.976+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=10, lastAvailableTime=2025-09-16T14:04:59.976+08:00 2025-09-16 14:04:59.976 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.s.compute.HostAgentDaoManager : Updating OCP agent last available time with status as available, hostId=9, lastAvailableTime=2025-09-16T14:04:59.976+08:00 2025-09-16 14:04:59.976 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:59.977 INFO 9 --- [host-check-agent-status3,640341a1ed8e6ce0,d88f01edc6b4c1fc] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.0.85:62888/api/v1/agent/status, params:null 2025-09-16 14:04:59.977 INFO 9 --- [host-check-agent-status2,640341a1ed8e6ce0,4c6a55600dad0ca4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.54 2025-09-16 14:04:59.977 INFO 9 --- [Check status for all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:04:59.977 INFO 9 --- [host-check-agent-status2,640341a1ed8e6ce0,4c6a55600dad0ca4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.54 2025-09-16 14:04:59.977 INFO 9 --- [host-check-agent-status2,640341a1ed8e6ce0,4c6a55600dad0ca4] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.54 2025-09-16 14:04:59.978 INFO 9 --- [host-check-agent-status5,640341a1ed8e6ce0,bccf59dc681f4b1f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.111 2025-09-16 14:04:59.978 INFO 9 --- [host-check-agent-status5,640341a1ed8e6ce0,bccf59dc681f4b1f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.111 2025-09-16 14:04:59.978 INFO 9 --- [host-check-agent-status5,640341a1ed8e6ce0,bccf59dc681f4b1f] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.111 2025-09-16 14:04:59.978 INFO 9 --- [host-check-agent-status4,640341a1ed8e6ce0,44f894447ee7aa13] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.104 2025-09-16 14:04:59.978 INFO 9 --- [host-check-agent-status4,640341a1ed8e6ce0,44f894447ee7aa13] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.104 2025-09-16 14:04:59.978 INFO 9 --- [host-check-agent-status4,640341a1ed8e6ce0,44f894447ee7aa13] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.104 2025-09-16 14:04:59.978 INFO 9 --- [host-check-agent-status6,640341a1ed8e6ce0,e3bd08856102840d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.159 2025-09-16 14:04:59.979 INFO 9 --- [host-check-agent-status6,640341a1ed8e6ce0,e3bd08856102840d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.159 2025-09-16 14:04:59.979 INFO 9 --- [host-check-agent-status6,640341a1ed8e6ce0,e3bd08856102840d] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.159 2025-09-16 14:04:59.979 INFO 9 --- [host-check-agent-status1,640341a1ed8e6ce0,2dc9e0421a519d5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.46 2025-09-16 14:04:59.979 INFO 9 --- [host-check-agent-status1,640341a1ed8e6ce0,2dc9e0421a519d5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.46 2025-09-16 14:04:59.979 INFO 9 --- [host-check-agent-status1,640341a1ed8e6ce0,2dc9e0421a519d5b] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.46 2025-09-16 14:04:59.980 INFO 9 --- [host-check-agent-status3,640341a1ed8e6ce0,d88f01edc6b4c1fc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_agentd status=running, hostIp=192.168.0.85 2025-09-16 14:04:59.980 INFO 9 --- [host-check-agent-status3,640341a1ed8e6ce0,d88f01edc6b4c1fc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mgragent status=running, hostIp=192.168.0.85 2025-09-16 14:04:59.980 INFO 9 --- [host-check-agent-status3,640341a1ed8e6ce0,d88f01edc6b4c1fc] c.o.o.c.h.manager.HostCheckManagerImpl : Host agent ocp_mongent status=running, hostIp=192.168.0.85 2025-09-16 14:04:59.982 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.s.compute.HostAgentDaoManager : Updated agent 5 last available time 2025-09-16T14:04:59.976+08:00 and status AVAILABLE 2025-09-16 14:04:59.982 INFO 9 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : check cluster status okay, clusterId=1, obVersion=4.3.5.3 2025-09-16 14:04:59.982 INFO 9 --- [ocp-schedules-29,19cc8c01c6b8ad17,5e6764544e7bf06b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:04:59.983 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.s.compute.HostAgentDaoManager : Updated agent 4 last available time 2025-09-16T14:04:59.976+08:00 and status AVAILABLE 2025-09-16 14:04:59.985 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.s.compute.HostAgentDaoManager : Updated agent 3 last available time 2025-09-16T14:04:59.976+08:00 and status AVAILABLE 2025-09-16 14:04:59.985 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=7 2025-09-16 14:04:59.986 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.s.compute.HostAgentDaoManager : Updated agent 6 last available time 2025-09-16T14:04:59.976+08:00 and status AVAILABLE 2025-09-16 14:04:59.986 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.s.compute.HostAgentDaoManager : Updated agent 1 last available time 2025-09-16T14:04:59.976+08:00 and status AVAILABLE 2025-09-16 14:04:59.987 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=8 2025-09-16 14:04:59.988 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.s.compute.HostAgentDaoManager : Updated agent 2 last available time 2025-09-16T14:04:59.976+08:00 and status AVAILABLE 2025-09-16 14:04:59.988 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=10 2025-09-16 14:04:59.990 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=12 2025-09-16 14:04:59.990 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=9 2025-09-16 14:04:59.991 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.h.manager.HostCheckManagerImpl : Refreshing OCP agent process running info: hostId=11 2025-09-16 14:04:59.991 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=7 2025-09-16 14:04:59.992 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 7 2025-09-16 14:04:59.993 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=8 2025-09-16 14:04:59.994 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 8 2025-09-16 14:04:59.994 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=10 2025-09-16 14:04:59.995 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 10 2025-09-16 14:04:59.996 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:04:59.996 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=9 2025-09-16 14:04:59.996 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:04:59.997 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=11 2025-09-16 14:04:59.997 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:04:59.997 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 9 2025-09-16 14:04:59.997 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 11 2025-09-16 14:04:59.998 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:05:00.005 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-09-16T14:05:00.002963+08:00, lastProcessTime=2025-09-16T14:04:50.002425+08:00 2025-09-16 14:05:00.006 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:05:00.008 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:05:00.010 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:05:00.012 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:05:00.012 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:05:00.013 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null 2025-09-16 14:05:00.034 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=13 2025-09-16 14:05:00.037 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=10 2025-09-16 14:05:00.037 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:05:00.038 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=7 2025-09-16 14:05:00.040 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=16 2025-09-16 14:05:00.040 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=13 2025-09-16 14:05:00.041 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=4 2025-09-16 14:05:00.041 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:05:00.042 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2025-09-16 14:05:00.043 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=10 2025-09-16 14:05:00.045 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=7 2025-09-16 14:05:00.046 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=16 2025-09-16 14:05:00.047 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=1 2025-09-16 14:05:00.048 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=4 2025-09-16 14:05:00.053 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=1 2025-09-16 14:05:00.056 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:05:00.059 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:05:00.059 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:05:00.060 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:05:00.060 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:05:00.065 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null 2025-09-16 14:05:00.077 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:05:00.079 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:05:00.080 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2025-09-16 14:05:00.084 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=14 2025-09-16 14:05:00.085 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:05:00.087 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=17 2025-09-16 14:05:00.087 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=5 2025-09-16 14:05:00.087 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2025-09-16 14:05:00.088 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=8 2025-09-16 14:05:00.089 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:05:00.091 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=14 2025-09-16 14:05:00.092 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=11 2025-09-16 14:05:00.094 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=17 2025-09-16 14:05:00.094 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=2 2025-09-16 14:05:00.094 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=5 2025-09-16 14:05:00.094 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=8 2025-09-16 14:05:00.099 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=11 2025-09-16 14:05:00.100 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=2 2025-09-16 14:05:00.104 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.46:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:05:00.106 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.85:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:05:00.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=5, name=zone5, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.106 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:05:00.107 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.104:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:05:00.107 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.111:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:05:00.110 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.54:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:05:00.112 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null 2025-09-16 14:05:00.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=5, ip=192.168.0.54, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=true, hostId=8, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:24.041878+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.125 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:05:00.130 INFO 9 --- [alarm-task-1,98db8e84f19e22eb,6aeca485263ea37c] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-09-16T14:05:00.002963+08:00 2025-09-16 14:05:00.131 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=15 2025-09-16 14:05:00.133 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=18 2025-09-16 14:05:00.135 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=6 2025-09-16 14:05:00.135 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=9 2025-09-16 14:05:00.137 INFO 9 --- [host-check-host-status1,cf9567d06c59a69e,37397635a12d00ba] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=15 2025-09-16 14:05:00.138 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=12 2025-09-16 14:05:00.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=4, name=zone4, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.140 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:05:00.140 INFO 9 --- [host-check-host-status3,cf9567d06c59a69e,511bd277f9527791] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=18 2025-09-16 14:05:00.141 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.h.s.HostProcessServiceImpl : Refreshing process running info: processId=3 2025-09-16 14:05:00.142 INFO 9 --- [host-check-host-status5,cf9567d06c59a69e,276e50b7c5546d37] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=6 2025-09-16 14:05:00.142 INFO 9 --- [host-check-host-status4,cf9567d06c59a69e,eaa58a128dfd8939] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=9 2025-09-16 14:05:00.145 INFO 9 --- [host-check-host-status2,cf9567d06c59a69e,8db05311d08a1b61] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=12 2025-09-16 14:05:00.148 INFO 9 --- [host-check-host-status6,cf9567d06c59a69e,ae6a0eaf04f0270c] c.o.o.c.a.p.AbstractProcessOperator : Refreshing process running info: id=3 2025-09-16 14:05:00.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=4, ip=192.168.0.85, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=9, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.088662+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.155 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:05:00.160 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 14:00:00.0, nextRun=2025-09-16 14:05:00.0, currentDate=Tue Sep 16 14:05:00 CST 2025 2025-09-16 14:05:00.160 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999977, name=DiagFuncUpdateSchedule, templateName=DiagFuncUpdateSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 14:00:00.0, nextRunTime=2025-09-16 14:05:00.0} 2025-09-16 14:05:00.163 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=DiagFuncUpdateSchedule, nodeCount=1, taskCount=1 2025-09-16 14:05:00.163 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='DiagFuncUpdateSchedule', taskDefinitionId=999977, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2025-09-16T14:05:00.163+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Update diag function, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.diagnosis.task.DiagFuncUpdateTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 14:05:00.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=3, name=zone3, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.168 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:05:00.171 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2025-09-16 14:00:00.0, nextRun=2025-09-16 14:05:00.0, currentDate=Tue Sep 16 14:05:00 CST 2025 2025-09-16 14:05:00.172 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2025-09-16 14:00:00.0, nextRunTime=2025-09-16 14:05:00.0} 2025-09-16 14:05:00.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=3, ip=192.168.0.104, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=10, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.099348+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.184 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:05:00.185 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[1] 2025-09-16 14:05:00.191 INFO 9 --- [ocp-async-7,a0d02d521caba0b7,0a7286de3325826b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2025-09-16 14:05:00.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone2, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.198 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:05:00.202 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.p.s.internal.SqlParseTaskSchedule : HighRiskSql Parse is ready 2025-09-16 14:05:00.205 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=SqlParseTaskSchedule, nodeCount=1, taskCount=1 2025-09-16 14:05:00.205 INFO 9 --- [task-coordinator3,25e389618b93fdc9,eb5a322a8539730a] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='SqlParseTaskSchedule', taskDefinitionId=999985, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.233.116.22', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={cluster_ids=[[1]]}}, createTime=null, startTime=2025-09-16T14:05:00.205+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Sql Parse Task, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.task.SqlParseTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='25e389618b93fdc9', operation=EXECUTE} 2025-09-16 14:05:00.214 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=192.168.0.111, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=11, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:25.089005+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.214 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null} 2025-09-16 14:05:00.228 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.228 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00} 2025-09-16 14:05:00.244 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=192.168.0.159, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.5.3_103010012025090210-8b80b225c2dcba7dd0c83f3d5a24e3c1ffc03f24(Sep 2 2025 10:31:17), withRootserver=false, hostId=12, status=RUNNING, innerStatus=ACTIVE, startTime=2025-09-15T18:17:29.212663+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING 2025-09-16 14:05:00.258 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:05:00.259 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:05:00.260 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2025-09-16 14:05:00.265 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster zhengqi 2025-09-16 14:05:00.268 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 2025-09-16 14:05:00.271 INFO 9 --- [Sync all clusters1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=12 2025-09-16 14:05:00.272 INFO 9 --- [Sync all clusters1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 12 2025-09-16 14:05:00.285 INFO 9 --- [Sync all clusters1,,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://192.168.0.159:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null 2025-09-16 14:05:00.347 INFO 9 --- [Sync all clusters1,,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 12, sqlPort: 2881 got ObProcessInfoResult(pid=52779, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase) 2025-09-16 14:05:00.360 INFO 9 --- [Sync all clusters1,,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=zhengqi, tenantName=sys, dbUser=ocp_monitor 2025-09-16 14:05:00.364 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [100000000] 2025-09-16 14:05:00.365 INFO 9 --- [Sync all clusters1,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ ocp_query */ arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2025-09-16 14:05:00.380 INFO 9 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=zhengqi, obClusterId=1 2025-09-16 14:05:00.380 INFO 9 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=zhengqi, obClusterId=1, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=CREATED, syncStatus=VALID, rootserverJson={"ObCluster":"zhengqi","ObClusterId":1,"ObRegion":"zhengqi","ObRegionId":1,"ReadonlyRsList":[],"RsList":[{"address":"192.168.0.54:2882","role":"LEADER","sql_port":2881},{"address":"192.168.0.85:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.104:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.111:2882","role":"FOLLOWER","sql_port":2881},{"address":"192.168.0.159:2882","role":"FOLLOWER","sql_port":2881}],"Type":"PRIMARY","timestamp":1758002242801000}, createTime=2025-09-15T18:11:47+08:00, creator=admin, obVersion=4.3.5.3, packageOperatingSystem=el7, loadType=HTAP, attributesJson={"DataDiskPath":"/data/oceanbase/data","DiskPathStyle":"DEFAULT","InstallPath":"/home/admin/oceanbase","LogDiskPath":"/data/oceanbase/log","OperatingSystemUser":"admin","RunPath":"/home/admin/oceanbase","SqlPort":2881,"SvrPort":2882}, tenantCount=3) 2025-09-16 14:05:00.380 INFO 9 --- [ocp-schedules-28,b065d8fada4f6a60,bae091b0e845a51e] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2025-09-16 14:05:00.669 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.233.116.22:8080 refreshes policies... 2025-09-16 14:05:00.669 INFO 9 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2025-09-16 14:05:00.829 WARN 9 --- [ocp-async-8,cb170b19a0cfab42,1a43a97221fb751b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2025-09-16 14:05:00.829 INFO 9 --- [ocp-async-10,7b3dc8ed3df40f6a,48174b7cad0672ed] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2025-09-16 14:05:00.889 INFO 9 --- [ocp-schedules-25,005f4557d5f56f8b,f84083bf1fae2615] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2025-09-16 14:05:01.162 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,e69934c458d253e4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1414, operation:EXECUTE, state: RUNNING 2025-09-16 14:05:01.169 INFO 9 --- [subtask-coordinator3,25e389618b93fdc9,e69934c458d253e4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1415, operation:EXECUTE, state: RUNNING 2025-09-16 14:05:01.174 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 14:05:01.174 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1414, context=Context{parallelIdx=-1, stringMap={task_instance_id=828, task_operation=execute, latest_execution_start_time=2025-09-16T14:05:01.158+08:00, sub_task_instance_name=Update diag function, sub_task_instance_id=1414}, listMap={}}, executor=10.233.116.22 2025-09-16 14:05:01.182 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.ocp.service.iam.user.UserService : user 200 login with organization 10000000 2025-09-16 14:05:01.184 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1415, context=Context{parallelIdx=0, stringMap={subtask_splitter=cluster_ids, task_instance_id=829, task_operation=execute, latest_execution_start_time=2025-09-16T14:05:01.168+08:00, sub_task_instance_name=Sql Parse Task, sub_task_instance_id=1415}, listMap={cluster_ids=[[1]]}}, executor=10.233.116.22 2025-09-16 14:05:01.184 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.o.p.sql.internal.task.SqlParseTask : parse sql for cluster:1 2025-09-16 14:05:01.190 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.228 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1002,1757980800000000,2000,30000000 2025-09-16 14:05:01.231 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.o.perf.sql.internal.SqlParseService : parse 0 sqls for tenant:ObTenantEntity{id=2, name=cos, obTenantId=1002, status=NORMAL} 2025-09-16 14:05:01.238 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.259 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.o.perf.sql.internal.SqlParseService : querySqlTextWithParams:1,zhengqi,1004,1757980800000000,2000,30000000 2025-09-16 14:05:01.262 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.o.perf.sql.internal.SqlParseService : parse 3 sqls for tenant:ObTenantEntity{id=3, name=vas_ucs, obTenantId=1004, status=NORMAL} 2025-09-16 14:05:01.267 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.303 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.327 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.350 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.367 INFO 9 --- [subtask-executor31,25e389618b93fdc9,f8dff65afa21e72d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1415, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 14:05:01.374 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.382 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.o.DiskUsageTimeRemainingOperator : no metrics data, skip predicting for zhengqi 2025-09-16 14:05:01.383 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.d.DiagnosisFuncUpdateService : update diag func fo cluster:zhengqi 2025-09-16 14:05:01.431 INFO 9 --- [subtask-executor30,25e389618b93fdc9,03c4efee1225992e] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1414, operation:EXECUTE, state: SUCCESSFUL 2025-09-16 14:05:01.636 INFO 9 --- [prometheus-minute-schedule-1,d521bd2588db32bd,82fbdaee421b7a53] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1758002760, interval=60 2025-09-16 14:05:01.640 INFO 9 --- [prometheus-minute-schedule-1,d521bd2588db32bd,82fbdaee421b7a53] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=17, collectTaskCount=17 2025-09-16 14:05:01.810 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:828, status:SUCCESS 2025-09-16 14:05:01.810 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:828, status:SUCCESS 2025-09-16 14:05:01.815 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:829, status:SUCCESS 2025-09-16 14:05:01.815 INFO 9 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:829, status:SUCCESS